Max level shown:
1 [ Mar 20 19:28:39 Enabled. ]
2 [ Mar 20 19:28:39 Rereading configuration. ]
3 [ Mar 20 19:28:41 Rereading configuration. ]
4 [ Mar 20 19:28:48 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id a7ae0e42-4671-47fd-a6f1-da0818409000 &"). ]
5 [ Mar 20 19:28:48 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-03-20T19:28:49.376ZDEBGoximeter: registered DTrace probes
82026-03-20T19:28:49.382ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:265
92026-03-20T19:28:49.382ZDEBGoximeter: creating ClickHouse client
102026-03-20T19:28:49.428ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
112026-03-20T19:28:53.070ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:900 id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
122026-03-20T19:28:53.070ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
132026-03-20T19:28:53.070ZINFOoximeter (clickhouse-client): reading db version collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:800 id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
142026-03-20T19:28:53.072ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:900 id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
152026-03-20T19:28:53.072ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:805 id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde version = 0
162026-03-20T19:28:53.072ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:810 id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
172026-03-20T19:28:53.072ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
182026-03-20T19:28:53.917ZINFOoximeter (clickhouse-client): inserting current version collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:831 id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde version = 14
192026-03-20T19:28:53.945ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 2c001689-713c-4068-a964-f10e2d0b27a7
202026-03-20T19:28:53.962ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-03-20T19:28:53.962ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-03-20T19:28:53.962ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-03-20T19:28:53.962ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-03-20T19:28:53.962ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::d]:12223
252026-03-20T19:28:53.972ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-03-20T19:28:53.972ZDEBGoximeter: registered USDT probes
272026-03-20T19:28:53.972ZDEBGoximeter: contacting nexus
282026-03-20T19:28:54.038ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
292026-03-20T19:28:54.435ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "21f45798-76fd-49b5-91db-9522b7b8d818", "date": "Fri, 20 Mar 2026 19:28:54 GMT"} })
302026-03-20T19:28:54.435ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:428 id = a7ae0e42-4671-47fd-a6f1-da0818409000
312026-03-20T19:28:54.436ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:554
322026-03-20T19:28:54.437ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
332026-03-20T19:28:54.439ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a7ae0e42-4671-47fd-a6f1-da0818409000/producers?sort_by=id_ascending
342026-03-20T19:28:54.439ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a7ae0e42-4671-47fd-a6f1-da0818409000/producers?sort_by=id_ascending", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
352026-03-20T19:28:54.441ZERROoximeter (oximeter-agent): error fetching next assigned producer, abandoning this refresh attempt collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a7ae0e42-4671-47fd-a6f1-da0818409000/producers?sort_by=id_ascending): error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a7ae0e42-4671-47fd-a6f1-da0818409000/producers?sort_by=id_ascending): client error (Connect): tcp connect error: Connection refused (os error 146) file = oximeter/collector/src/agent.rs:595
362026-03-20T19:29:09.437ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
372026-03-20T19:29:09.437ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a7ae0e42-4671-47fd-a6f1-da0818409000/producers?sort_by=id_ascending
382026-03-20T19:29:09.461ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a7ae0e42-4671-47fd-a6f1-da0818409000/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "26459179-d4ad-4c68-8cc6-f8680a7ec934", "content-length": "436", "date": "Fri, 20 Mar 2026 19:29:09 GMT"} })
392026-03-20T19:29:09.476ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a7ae0e42-4671-47fd-a6f1-da0818409000/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiIyMDA4YzBkNC00NGY5LTRkNGEtODk4Yi1iNzc5YzBiOTlkZTcifX0%3D
402026-03-20T19:29:09.481ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a7ae0e42-4671-47fd-a6f1-da0818409000/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiIyMDA4YzBkNC00NGY5LTRkNGEtODk4Yi1iNzc5YzBiOTlkZTcifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "294125e6-d9b0-450b-9bf3-bde96d4606a6", "content-length": "29", "date": "Fri, 20 Mar 2026 19:29:09 GMT"} })
412026-03-20T19:29:09.481ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc
422026-03-20T19:29:09.482ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:62326 collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 2008c0d4-44f9-4d4a-898b-b779c0b99de7
432026-03-20T19:29:09.482ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 2 n_pruned_tasks = 0
442026-03-20T19:29:09.482ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 2008c0d4-44f9-4d4a-898b-b779c0b99de7 producer_ip = fd00:1122:3344:101::2 producer_port = 62326
452026-03-20T19:29:09.482ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
462026-03-20T19:29:09.553ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
472026-03-20T19:29:09.553ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 2008c0d4-44f9-4d4a-898b-b779c0b99de7 producer_ip = fd00:1122:3344:101::2 producer_port = 62326
482026-03-20T19:29:09.553ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 2008c0d4-44f9-4d4a-898b-b779c0b99de7 producer_ip = fd00:1122:3344:101::2 producer_port = 62326
492026-03-20T19:29:09.553ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
502026-03-20T19:29:09.580ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2008c0d4-44f9-4d4a-898b-b779c0b99de7 producer_ip = fd00:1122:3344:101::2 producer_port = 62326
512026-03-20T19:29:09.590ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
522026-03-20T19:29:10.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
532026-03-20T19:29:10.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
542026-03-20T19:29:10.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
552026-03-20T19:29:11.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
562026-03-20T19:29:11.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
572026-03-20T19:29:11.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
582026-03-20T19:29:12.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
592026-03-20T19:29:12.483ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
602026-03-20T19:29:12.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
612026-03-20T19:29:13.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
622026-03-20T19:29:13.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
632026-03-20T19:29:13.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
642026-03-20T19:29:13.946ZDEBGoximeter (results-sink): inserting 294 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
652026-03-20T19:29:13.946ZDEBGoximeter (results-sink-cluster): inserting 294 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
662026-03-20T19:29:13.946ZDEBGoximeter (clickhouse-client): unrolling 294 total samples collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
672026-03-20T19:29:13.946ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
682026-03-20T19:29:13.950ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:13.946387396Z } timeseries_name = oximeter_collector:collections
692026-03-20T19:29:13.964ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
702026-03-20T19:29:13.974ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:13.964009087Z } timeseries_name = switch_port_control_data_link:errors_received
712026-03-20T19:29:13.976ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
722026-03-20T19:29:13.979ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:13.976170827Z } timeseries_name = switch_port_control_data_link:errors_sent
732026-03-20T19:29:13.979ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
742026-03-20T19:29:13.980ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:13.979387025Z } timeseries_name = switch_port_control_data_link:bytes_received
752026-03-20T19:29:13.980ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
762026-03-20T19:29:13.981ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:13.980473151Z } timeseries_name = switch_port_control_data_link:packets_received
772026-03-20T19:29:13.981ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
782026-03-20T19:29:13.982ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:13.981523926Z } timeseries_name = switch_port_control_data_link:bytes_sent
792026-03-20T19:29:13.982ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
802026-03-20T19:29:13.983ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:13.982501581Z } timeseries_name = switch_port_control_data_link:packets_sent
812026-03-20T19:29:13.990ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
822026-03-20T19:29:13.991ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:13.990542510Z } timeseries_name = ddm_router:originated_underlay_prefixes
832026-03-20T19:29:13.991ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
842026-03-20T19:29:13.992ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:13.991556635Z } timeseries_name = ddm_router:originated_tunnel_endpoints
852026-03-20T19:29:13.992ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
862026-03-20T19:29:13.993ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:13.992515889Z } timeseries_name = ddm_session:solicitations_sent
872026-03-20T19:29:13.993ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
882026-03-20T19:29:13.994ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:13.993450913Z } timeseries_name = ddm_session:solicitations_received
892026-03-20T19:29:13.994ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
902026-03-20T19:29:13.995ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:13.994438098Z } timeseries_name = ddm_session:advertisements_sent
912026-03-20T19:29:13.995ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
922026-03-20T19:29:13.996ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:13.995415162Z } timeseries_name = ddm_session:advertisements_received
932026-03-20T19:29:13.996ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
942026-03-20T19:29:13.997ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:13.996428757Z } timeseries_name = ddm_session:peer_expirations
952026-03-20T19:29:13.997ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
962026-03-20T19:29:13.998ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:13.997403802Z } timeseries_name = ddm_session:peer_address_changes
972026-03-20T19:29:13.998ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
982026-03-20T19:29:13.999ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:13.998385996Z } timeseries_name = ddm_session:peer_sessions_established
992026-03-20T19:29:13.999ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
1002026-03-20T19:29:14.000ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:13.999363291Z } timeseries_name = ddm_session:updates_sent
1012026-03-20T19:29:14.000ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
1022026-03-20T19:29:14.001ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:14.000519708Z } timeseries_name = ddm_session:updates_received
1032026-03-20T19:29:14.001ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
1042026-03-20T19:29:14.002ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:14.001513163Z } timeseries_name = ddm_session:update_send_fail
1052026-03-20T19:29:14.002ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
1062026-03-20T19:29:14.003ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:14.002554028Z } timeseries_name = ddm_session:imported_underlay_prefixes
1072026-03-20T19:29:14.003ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
1082026-03-20T19:29:14.004ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:14.003795236Z } timeseries_name = ddm_session:imported_tunnel_endpoints
1092026-03-20T19:29:14.010ZDEBGoximeter (clickhouse-client): inserting 21 new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
1102026-03-20T19:29:14.029ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 24 table_name = fields_i16
1112026-03-20T19:29:14.031ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 4 table_name = fields_ipaddr
1122026-03-20T19:29:14.033ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 148 table_name = fields_string
1132026-03-20T19:29:14.035ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 16 table_name = fields_u16
1142026-03-20T19:29:14.036ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 24 table_name = fields_u32
1152026-03-20T19:29:14.038ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 12 table_name = fields_u8
1162026-03-20T19:29:14.040ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 68 table_name = fields_uuid
1172026-03-20T19:29:14.044ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 264 table_name = measurements_cumulativeu64
1182026-03-20T19:29:14.046ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 30 table_name = measurements_u64
1192026-03-20T19:29:14.047ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
1202026-03-20T19:29:14.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1212026-03-20T19:29:14.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1222026-03-20T19:29:14.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1232026-03-20T19:29:15.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1242026-03-20T19:29:15.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1252026-03-20T19:29:15.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1262026-03-20T19:29:16.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1272026-03-20T19:29:16.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1282026-03-20T19:29:16.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1292026-03-20T19:29:17.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1302026-03-20T19:29:17.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1312026-03-20T19:29:17.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1322026-03-20T19:29:18.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1332026-03-20T19:29:18.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1342026-03-20T19:29:18.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1352026-03-20T19:29:18.946ZDEBGoximeter (results-sink): inserting 130 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
1362026-03-20T19:29:18.946ZDEBGoximeter (results-sink-cluster): inserting 130 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
1372026-03-20T19:29:18.946ZDEBGoximeter (clickhouse-client): unrolling 130 total samples collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
1382026-03-20T19:29:18.954ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 26 table_name = fields_string
1392026-03-20T19:29:18.956ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 28 table_name = fields_uuid
1402026-03-20T19:29:18.958ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 100 table_name = measurements_cumulativeu64
1412026-03-20T19:29:18.960ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 30 table_name = measurements_u64
1422026-03-20T19:29:19.047ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
1432026-03-20T19:29:19.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1442026-03-20T19:29:19.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1452026-03-20T19:29:19.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1462026-03-20T19:29:20.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1472026-03-20T19:29:20.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1482026-03-20T19:29:20.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1492026-03-20T19:29:21.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1502026-03-20T19:29:21.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1512026-03-20T19:29:21.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1522026-03-20T19:29:22.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1532026-03-20T19:29:22.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1542026-03-20T19:29:22.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1552026-03-20T19:29:23.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1562026-03-20T19:29:23.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1572026-03-20T19:29:23.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1582026-03-20T19:29:23.946ZDEBGoximeter (results-sink): inserting 130 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
1592026-03-20T19:29:23.946ZDEBGoximeter (results-sink-cluster): inserting 130 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
1602026-03-20T19:29:23.946ZDEBGoximeter (clickhouse-client): unrolling 130 total samples collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
1612026-03-20T19:29:23.953ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 26 table_name = fields_string
1622026-03-20T19:29:23.955ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 28 table_name = fields_uuid
1632026-03-20T19:29:23.957ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 100 table_name = measurements_cumulativeu64
1642026-03-20T19:29:23.959ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 30 table_name = measurements_u64
1652026-03-20T19:29:24.047ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
1662026-03-20T19:29:24.437ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
1672026-03-20T19:29:24.437ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a7ae0e42-4671-47fd-a6f1-da0818409000/producers?sort_by=id_ascending
1682026-03-20T19:29:24.440ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a7ae0e42-4671-47fd-a6f1-da0818409000/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "edfc6914-eabe-494a-93b6-25ecf6cc1c37", "content-length": "1000", "date": "Fri, 20 Mar 2026 19:29:24 GMT"} })
1692026-03-20T19:29:24.440ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a7ae0e42-4671-47fd-a6f1-da0818409000/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjM2Y1YmE2MC04ZTRkLTQ0ZDctODVlYy1hMjEyYmFlNjAyYzYifX0%3D
1702026-03-20T19:29:24.449ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a7ae0e42-4671-47fd-a6f1-da0818409000/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjM2Y1YmE2MC04ZTRkLTQ0ZDctODVlYy1hMjEyYmFlNjAyYzYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "920ff0a9-4b08-4b02-8f4e-f270ae682655", "content-length": "29", "date": "Fri, 20 Mar 2026 19:29:24 GMT"} })
1712026-03-20T19:29:24.449ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:55827 collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 064f1755-0a55-4fca-9bd7-ec0ae205759d
1722026-03-20T19:29:24.449ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:33069 collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 3a2f314d-2e3b-4a92-9b40-37a8b2efea1c
1732026-03-20T19:29:24.449ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9
1742026-03-20T19:29:24.449ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:49140 collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = c3f5ba60-8e4d-44d7-85ec-a212bae602c6
1752026-03-20T19:29:24.449ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 6 n_pruned_tasks = 0
1762026-03-20T19:29:24.450ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 064f1755-0a55-4fca-9bd7-ec0ae205759d producer_ip = fd00:1122:3344:101::c producer_port = 55827
1772026-03-20T19:29:24.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1782026-03-20T19:29:24.450ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1792026-03-20T19:29:24.450ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = c3f5ba60-8e4d-44d7-85ec-a212bae602c6 producer_ip = fd00:1122:3344:101::2 producer_port = 49140
1802026-03-20T19:29:24.450ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 3a2f314d-2e3b-4a92-9b40-37a8b2efea1c producer_ip = fd00:1122:3344:101::1 producer_port = 33069
1812026-03-20T19:29:24.451ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 064f1755-0a55-4fca-9bd7-ec0ae205759d producer_ip = fd00:1122:3344:101::c producer_port = 55827
1822026-03-20T19:29:24.451ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = c3f5ba60-8e4d-44d7-85ec-a212bae602c6 producer_ip = fd00:1122:3344:101::2 producer_port = 49140
1832026-03-20T19:29:24.451ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 3a2f314d-2e3b-4a92-9b40-37a8b2efea1c producer_ip = fd00:1122:3344:101::1 producer_port = 33069
1842026-03-20T19:29:24.452ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 064f1755-0a55-4fca-9bd7-ec0ae205759d producer_ip = fd00:1122:3344:101::c producer_port = 55827
1852026-03-20T19:29:24.452ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 3a2f314d-2e3b-4a92-9b40-37a8b2efea1c producer_ip = fd00:1122:3344:101::1 producer_port = 33069
1862026-03-20T19:29:24.453ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = c3f5ba60-8e4d-44d7-85ec-a212bae602c6 producer_ip = fd00:1122:3344:101::2 producer_port = 49140
1872026-03-20T19:29:24.453ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1882026-03-20T19:29:24.470ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1892026-03-20T19:29:24.473ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = c3f5ba60-8e4d-44d7-85ec-a212bae602c6 producer_ip = fd00:1122:3344:101::2 producer_port = 49140
1902026-03-20T19:29:24.474ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 064f1755-0a55-4fca-9bd7-ec0ae205759d producer_ip = fd00:1122:3344:101::c producer_port = 55827
1912026-03-20T19:29:24.483ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1922026-03-20T19:29:24.483ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1932026-03-20T19:29:24.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1942026-03-20T19:29:24.596ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 3a2f314d-2e3b-4a92-9b40-37a8b2efea1c producer_ip = fd00:1122:3344:101::1 producer_port = 33069
1952026-03-20T19:29:24.611ZDEBGoximeter (results-sink-cluster): inserting 2658 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
1962026-03-20T19:29:24.611ZDEBGoximeter (results-sink): inserting 2658 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
1972026-03-20T19:29:24.611ZDEBGoximeter (clickhouse-client): unrolling 2658 total samples collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
1982026-03-20T19:29:24.611ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
1992026-03-20T19:29:24.647ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:24.611487314Z } timeseries_name = static_routing_config:static_routes
2002026-03-20T19:29:24.647ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
2012026-03-20T19:29:24.649ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:24.647951975Z } timeseries_name = static_routing_config:static_nexthops
2022026-03-20T19:29:24.649ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
2032026-03-20T19:29:24.651ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:24.649881363Z } timeseries_name = switch_rib:active_routes
2042026-03-20T19:29:24.651ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
2052026-03-20T19:29:24.653ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:24.651612899Z } timeseries_name = mg_lower:routes_blocked_by_link_state
2062026-03-20T19:29:24.653ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
2072026-03-20T19:29:24.654ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:24.653217282Z } timeseries_name = http_service:request_latency_histogram
2082026-03-20T19:29:24.656ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
2092026-03-20T19:29:24.658ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:24.656927688Z } timeseries_name = collection_target:cpus_provisioned
2102026-03-20T19:29:24.658ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
2112026-03-20T19:29:24.660ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:24.658670273Z } timeseries_name = collection_target:ram_provisioned
2122026-03-20T19:29:24.660ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
2132026-03-20T19:29:24.661ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:24.660244867Z } timeseries_name = collection_target:virtual_disk_space_provisioned
2142026-03-20T19:29:24.662ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
2152026-03-20T19:29:24.664ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("database_transaction:retry_data"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "attempt", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:24.662852965Z } timeseries_name = database_transaction:retry_data
2162026-03-20T19:29:24.665ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
2172026-03-20T19:29:24.667ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_cpu:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "cpu_id", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:24.665607206Z } timeseries_name = sled_cpu:cpu_nsec
2182026-03-20T19:29:24.688ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
2192026-03-20T19:29:24.690ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:24.688714179Z } timeseries_name = sled_data_link:errors_received
2202026-03-20T19:29:24.690ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
2212026-03-20T19:29:24.692ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:24.690679498Z } timeseries_name = sled_data_link:errors_sent
2222026-03-20T19:29:24.692ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
2232026-03-20T19:29:24.694ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:24.692468954Z } timeseries_name = sled_data_link:bytes_received
2242026-03-20T19:29:24.694ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
2252026-03-20T19:29:24.696ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:24.694472694Z } timeseries_name = sled_data_link:packets_received
2262026-03-20T19:29:24.696ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
2272026-03-20T19:29:24.697ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:24.696143879Z } timeseries_name = sled_data_link:bytes_sent
2282026-03-20T19:29:24.697ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
2292026-03-20T19:29:24.699ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:24.697987866Z } timeseries_name = sled_data_link:packets_sent
2302026-03-20T19:29:24.713ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
2312026-03-20T19:29:24.716ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
2322026-03-20T19:29:24.717ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("zone:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_type", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:24.716133985Z } timeseries_name = zone:cpu_nsec
2332026-03-20T19:29:24.779ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
2342026-03-20T19:29:24.781ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("kstat_sampler:samples_dropped"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "target_id", field_type: U64, source: Metric, description: "" }, FieldSchema { name: "target_name", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:24.779694707Z } timeseries_name = kstat_sampler:samples_dropped
2352026-03-20T19:29:24.782ZDEBGoximeter (clickhouse-client): inserting 18 new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
2362026-03-20T19:29:24.786ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 8 table_name = fields_ipaddr
2372026-03-20T19:29:24.790ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 2438 table_name = fields_string
2382026-03-20T19:29:24.792ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 45 table_name = fields_u16
2392026-03-20T19:29:24.794ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 802 table_name = fields_u32
2402026-03-20T19:29:24.795ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 2 table_name = fields_u64
2412026-03-20T19:29:24.798ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 1312 table_name = fields_uuid
2422026-03-20T19:29:24.801ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 2588 table_name = measurements_cumulativeu64
2432026-03-20T19:29:24.802ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 1 table_name = measurements_f64
2442026-03-20T19:29:24.807ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 37 table_name = measurements_histogramu64
2452026-03-20T19:29:24.810ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 24 table_name = measurements_i64
2462026-03-20T19:29:24.812ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 8 table_name = measurements_u64
2472026-03-20T19:29:25.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2482026-03-20T19:29:25.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2492026-03-20T19:29:25.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2502026-03-20T19:29:25.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2512026-03-20T19:29:25.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2522026-03-20T19:29:25.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2532026-03-20T19:29:26.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2542026-03-20T19:29:26.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2552026-03-20T19:29:26.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2562026-03-20T19:29:26.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2572026-03-20T19:29:26.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2582026-03-20T19:29:26.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2592026-03-20T19:29:27.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2602026-03-20T19:29:27.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2612026-03-20T19:29:27.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2622026-03-20T19:29:27.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2632026-03-20T19:29:27.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2642026-03-20T19:29:27.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2652026-03-20T19:29:28.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2662026-03-20T19:29:28.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2672026-03-20T19:29:28.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2682026-03-20T19:29:28.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2692026-03-20T19:29:28.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2702026-03-20T19:29:28.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2712026-03-20T19:29:28.946ZDEBGoximeter (results-sink): inserting 120 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
2722026-03-20T19:29:28.946ZDEBGoximeter (results-sink-cluster): inserting 120 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
2732026-03-20T19:29:28.946ZDEBGoximeter (clickhouse-client): unrolling 120 total samples collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
2742026-03-20T19:29:28.953ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 30 table_name = fields_string
2752026-03-20T19:29:28.955ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 36 table_name = fields_uuid
2762026-03-20T19:29:28.957ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 88 table_name = measurements_cumulativeu64
2772026-03-20T19:29:28.958ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 32 table_name = measurements_u64
2782026-03-20T19:29:29.048ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
2792026-03-20T19:29:29.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2802026-03-20T19:29:29.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2812026-03-20T19:29:29.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2822026-03-20T19:29:29.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2832026-03-20T19:29:29.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2842026-03-20T19:29:29.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2852026-03-20T19:29:30.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2862026-03-20T19:29:30.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2872026-03-20T19:29:30.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2882026-03-20T19:29:30.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2892026-03-20T19:29:30.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2902026-03-20T19:29:30.486ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2912026-03-20T19:29:31.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2922026-03-20T19:29:31.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2932026-03-20T19:29:31.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2942026-03-20T19:29:31.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2952026-03-20T19:29:31.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2962026-03-20T19:29:31.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2972026-03-20T19:29:32.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2982026-03-20T19:29:32.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2992026-03-20T19:29:32.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3002026-03-20T19:29:32.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3012026-03-20T19:29:32.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3022026-03-20T19:29:32.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3032026-03-20T19:29:33.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3042026-03-20T19:29:33.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3052026-03-20T19:29:33.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3062026-03-20T19:29:33.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3072026-03-20T19:29:33.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3082026-03-20T19:29:33.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3092026-03-20T19:29:33.946ZDEBGoximeter (results-sink): inserting 150 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
3102026-03-20T19:29:33.946ZDEBGoximeter (results-sink-cluster): inserting 150 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
3112026-03-20T19:29:33.946ZDEBGoximeter (clickhouse-client): unrolling 150 total samples collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
3122026-03-20T19:29:33.954ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 30 table_name = fields_string
3132026-03-20T19:29:33.955ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 36 table_name = fields_uuid
3142026-03-20T19:29:33.957ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 110 table_name = measurements_cumulativeu64
3152026-03-20T19:29:33.958ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 40 table_name = measurements_u64
3162026-03-20T19:29:34.047ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
3172026-03-20T19:29:34.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 064f1755-0a55-4fca-9bd7-ec0ae205759d producer_ip = fd00:1122:3344:101::c producer_port = 55827
3182026-03-20T19:29:34.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = c3f5ba60-8e4d-44d7-85ec-a212bae602c6 producer_ip = fd00:1122:3344:101::2 producer_port = 49140
3192026-03-20T19:29:34.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3202026-03-20T19:29:34.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 064f1755-0a55-4fca-9bd7-ec0ae205759d producer_ip = fd00:1122:3344:101::c producer_port = 55827
3212026-03-20T19:29:34.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = c3f5ba60-8e4d-44d7-85ec-a212bae602c6 producer_ip = fd00:1122:3344:101::2 producer_port = 49140
3222026-03-20T19:29:34.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3232026-03-20T19:29:34.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3242026-03-20T19:29:34.453ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = c3f5ba60-8e4d-44d7-85ec-a212bae602c6 producer_ip = fd00:1122:3344:101::2 producer_port = 49140
3252026-03-20T19:29:34.454ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 064f1755-0a55-4fca-9bd7-ec0ae205759d producer_ip = fd00:1122:3344:101::c producer_port = 55827
3262026-03-20T19:29:34.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3272026-03-20T19:29:34.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3282026-03-20T19:29:34.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3292026-03-20T19:29:35.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3302026-03-20T19:29:35.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3312026-03-20T19:29:35.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3322026-03-20T19:29:35.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3332026-03-20T19:29:35.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3342026-03-20T19:29:35.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3352026-03-20T19:29:36.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3362026-03-20T19:29:36.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3372026-03-20T19:29:36.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3382026-03-20T19:29:36.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3392026-03-20T19:29:36.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3402026-03-20T19:29:36.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3412026-03-20T19:29:37.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3422026-03-20T19:29:37.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3432026-03-20T19:29:37.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3442026-03-20T19:29:37.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3452026-03-20T19:29:37.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3462026-03-20T19:29:37.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3472026-03-20T19:29:38.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3482026-03-20T19:29:38.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3492026-03-20T19:29:38.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3502026-03-20T19:29:38.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3512026-03-20T19:29:38.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3522026-03-20T19:29:38.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3532026-03-20T19:29:38.946ZDEBGoximeter (results-sink): inserting 184 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
3542026-03-20T19:29:38.946ZDEBGoximeter (results-sink-cluster): inserting 184 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
3552026-03-20T19:29:38.946ZDEBGoximeter (clickhouse-client): unrolling 184 total samples collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
3562026-03-20T19:29:38.955ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 98 table_name = fields_string
3572026-03-20T19:29:38.957ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 34 table_name = fields_u16
3582026-03-20T19:29:38.958ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 70 table_name = fields_uuid
3592026-03-20T19:29:38.959ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 110 table_name = measurements_cumulativeu64
3602026-03-20T19:29:38.961ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 34 table_name = measurements_histogramu64
3612026-03-20T19:29:38.963ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 40 table_name = measurements_u64
3622026-03-20T19:29:39.047ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
3632026-03-20T19:29:39.437ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
3642026-03-20T19:29:39.437ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a7ae0e42-4671-47fd-a6f1-da0818409000/producers?sort_by=id_ascending
3652026-03-20T19:29:39.444ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a7ae0e42-4671-47fd-a6f1-da0818409000/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "d033ddec-2791-462b-9453-4545f35190d3", "content-length": "1136", "date": "Fri, 20 Mar 2026 19:29:39 GMT"} })
3662026-03-20T19:29:39.444ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a7ae0e42-4671-47fd-a6f1-da0818409000/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjM2Y1YmE2MC04ZTRkLTQ0ZDctODVlYy1hMjEyYmFlNjAyYzYifX0%3D
3672026-03-20T19:29:39.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3682026-03-20T19:29:39.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3692026-03-20T19:29:39.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3702026-03-20T19:29:39.452ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/a7ae0e42-4671-47fd-a6f1-da0818409000/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjM2Y1YmE2MC04ZTRkLTQ0ZDctODVlYy1hMjEyYmFlNjAyYzYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd63d1d6-dcc7-4fdf-8a30-b4627a6a830b", "content-length": "29", "date": "Fri, 20 Mar 2026 19:29:39 GMT"} })
3712026-03-20T19:29:39.452ZDEBGoximeter (oximeter-agent): received request to register existing metric producer, updating collection information address = [fd00:1122:3344:101::2]:55701 collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = 2008c0d4-44f9-4d4a-898b-b779c0b99de7
3722026-03-20T19:29:39.452ZDEBGoximeter (collection-task-handle): notified collection task of new producer endpoint collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 2008c0d4-44f9-4d4a-898b-b779c0b99de7 producer_ip = fd00:1122:3344:101::2 producer_port = 62326
3732026-03-20T19:29:39.452ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c
3742026-03-20T19:29:39.452ZDEBGoximeter (collection-task): collection task received request to update its producer information address = [fd00:1122:3344:101::2]:55701 collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = 2008c0d4-44f9-4d4a-898b-b779c0b99de7 producer_ip = fd00:1122:3344:101::2 producer_port = 62326
3752026-03-20T19:29:39.452ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 7 n_pruned_tasks = 0
3762026-03-20T19:29:39.453ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 2008c0d4-44f9-4d4a-898b-b779c0b99de7 producer_ip = fd00:1122:3344:101::2 producer_port = 62326
3772026-03-20T19:29:39.453ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 2008c0d4-44f9-4d4a-898b-b779c0b99de7 producer_ip = fd00:1122:3344:101::2 producer_port = 62326
3782026-03-20T19:29:39.453ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3792026-03-20T19:29:39.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3802026-03-20T19:29:39.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3812026-03-20T19:29:39.466ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3822026-03-20T19:29:39.478ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2008c0d4-44f9-4d4a-898b-b779c0b99de7 producer_ip = fd00:1122:3344:101::2 producer_port = 62326
3832026-03-20T19:29:39.481ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3842026-03-20T19:29:39.481ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3852026-03-20T19:29:39.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3862026-03-20T19:29:40.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3872026-03-20T19:29:40.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3882026-03-20T19:29:40.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3892026-03-20T19:29:40.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3902026-03-20T19:29:40.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3912026-03-20T19:29:40.456ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3922026-03-20T19:29:40.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3932026-03-20T19:29:40.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3942026-03-20T19:29:40.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3952026-03-20T19:29:41.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3962026-03-20T19:29:41.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3972026-03-20T19:29:41.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3982026-03-20T19:29:41.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3992026-03-20T19:29:41.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4002026-03-20T19:29:41.456ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4012026-03-20T19:29:41.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4022026-03-20T19:29:41.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4032026-03-20T19:29:41.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4042026-03-20T19:29:42.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4052026-03-20T19:29:42.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4062026-03-20T19:29:42.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4072026-03-20T19:29:42.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4082026-03-20T19:29:42.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4092026-03-20T19:29:42.456ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4102026-03-20T19:29:42.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4112026-03-20T19:29:42.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4122026-03-20T19:29:42.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4132026-03-20T19:29:43.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4142026-03-20T19:29:43.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4152026-03-20T19:29:43.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4162026-03-20T19:29:43.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4172026-03-20T19:29:43.455ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4182026-03-20T19:29:43.456ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4192026-03-20T19:29:43.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4202026-03-20T19:29:43.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4212026-03-20T19:29:43.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4222026-03-20T19:29:43.946ZDEBGoximeter (results-sink): inserting 363 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
4232026-03-20T19:29:43.947ZDEBGoximeter (results-sink-cluster): inserting 363 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
4242026-03-20T19:29:43.947ZDEBGoximeter (clickhouse-client): unrolling 363 total samples collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
4252026-03-20T19:29:43.948ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
4262026-03-20T19:29:43.953ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:43.948151942Z } timeseries_name = switch_data_link:link_enabled
4272026-03-20T19:29:43.953ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
4282026-03-20T19:29:43.955ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:43.953390430Z } timeseries_name = switch_data_link:link_up
4292026-03-20T19:29:43.955ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
4302026-03-20T19:29:43.957ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:43.955883207Z } timeseries_name = switch_table:capacity
4312026-03-20T19:29:43.957ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
4322026-03-20T19:29:43.959ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:43.957963048Z } timeseries_name = switch_table:occupancy
4332026-03-20T19:29:43.960ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
4342026-03-20T19:29:43.962ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:43.960018138Z } timeseries_name = switch_table:inserts
4352026-03-20T19:29:43.962ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
4362026-03-20T19:29:43.964ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:43.962182170Z } timeseries_name = switch_table:deletes
4372026-03-20T19:29:43.964ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
4382026-03-20T19:29:43.966ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:43.964273401Z } timeseries_name = switch_table:updates
4392026-03-20T19:29:43.966ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
4402026-03-20T19:29:43.968ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:43.966485314Z } timeseries_name = switch_table:collisions
4412026-03-20T19:29:43.968ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
4422026-03-20T19:29:43.970ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:43.968564254Z } timeseries_name = switch_table:update_misses
4432026-03-20T19:29:43.970ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
4442026-03-20T19:29:43.972ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:43.970752117Z } timeseries_name = switch_table:delete_misses
4452026-03-20T19:29:43.972ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
4462026-03-20T19:29:43.974ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:43.972940570Z } timeseries_name = switch_table:exhaustion
4472026-03-20T19:29:43.982ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
4482026-03-20T19:29:43.984ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-20T19:29:43.982598753Z } timeseries_name = dendrite:sample_collection_duration
4492026-03-20T19:29:43.991ZDEBGoximeter (clickhouse-client): inserting 12 new timeseries schema collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
4502026-03-20T19:29:43.995ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 284 table_name = fields_i16
4512026-03-20T19:29:43.996ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 2 table_name = fields_ipaddr
4522026-03-20T19:29:43.998ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 798 table_name = fields_string
4532026-03-20T19:29:43.999ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 144 table_name = fields_u16
4542026-03-20T19:29:44.001ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 149 table_name = fields_u32
4552026-03-20T19:29:44.003ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 148 table_name = fields_u8
4562026-03-20T19:29:44.004ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 492 table_name = fields_uuid
4572026-03-20T19:29:44.006ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 6 table_name = measurements_bool
4582026-03-20T19:29:44.008ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 266 table_name = measurements_cumulativeu64
4592026-03-20T19:29:44.009ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 1 table_name = measurements_f64
4602026-03-20T19:29:44.011ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 90 table_name = measurements_u64
4612026-03-20T19:29:44.048ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
4622026-03-20T19:29:44.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 064f1755-0a55-4fca-9bd7-ec0ae205759d producer_ip = fd00:1122:3344:101::c producer_port = 55827
4632026-03-20T19:29:44.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 064f1755-0a55-4fca-9bd7-ec0ae205759d producer_ip = fd00:1122:3344:101::c producer_port = 55827
4642026-03-20T19:29:44.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4652026-03-20T19:29:44.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4662026-03-20T19:29:44.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = c3f5ba60-8e4d-44d7-85ec-a212bae602c6 producer_ip = fd00:1122:3344:101::2 producer_port = 49140
4672026-03-20T19:29:44.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = c3f5ba60-8e4d-44d7-85ec-a212bae602c6 producer_ip = fd00:1122:3344:101::2 producer_port = 49140
4682026-03-20T19:29:44.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4692026-03-20T19:29:44.452ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = c3f5ba60-8e4d-44d7-85ec-a212bae602c6 producer_ip = fd00:1122:3344:101::2 producer_port = 49140
4702026-03-20T19:29:44.453ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 064f1755-0a55-4fca-9bd7-ec0ae205759d producer_ip = fd00:1122:3344:101::c producer_port = 55827
4712026-03-20T19:29:44.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4722026-03-20T19:29:44.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4732026-03-20T19:29:44.455ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4742026-03-20T19:29:44.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4752026-03-20T19:29:44.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4762026-03-20T19:29:44.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4772026-03-20T19:29:45.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4782026-03-20T19:29:45.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4792026-03-20T19:29:45.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4802026-03-20T19:29:45.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4812026-03-20T19:29:45.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4822026-03-20T19:29:45.455ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4832026-03-20T19:29:45.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4842026-03-20T19:29:45.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4852026-03-20T19:29:45.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4862026-03-20T19:29:46.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4872026-03-20T19:29:46.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4882026-03-20T19:29:46.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4892026-03-20T19:29:46.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4902026-03-20T19:29:46.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4912026-03-20T19:29:46.456ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4922026-03-20T19:29:46.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4932026-03-20T19:29:46.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4942026-03-20T19:29:46.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4952026-03-20T19:29:47.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4962026-03-20T19:29:47.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4972026-03-20T19:29:47.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4982026-03-20T19:29:47.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4992026-03-20T19:29:47.455ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5002026-03-20T19:29:47.456ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5012026-03-20T19:29:47.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5022026-03-20T19:29:47.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5032026-03-20T19:29:47.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5042026-03-20T19:29:48.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5052026-03-20T19:29:48.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5062026-03-20T19:29:48.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5072026-03-20T19:29:48.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5082026-03-20T19:29:48.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5092026-03-20T19:29:48.455ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5102026-03-20T19:29:48.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5112026-03-20T19:29:48.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5122026-03-20T19:29:48.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5132026-03-20T19:29:48.946ZDEBGoximeter (results-sink): inserting 255 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
5142026-03-20T19:29:48.946ZDEBGoximeter (results-sink-cluster): inserting 255 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
5152026-03-20T19:29:48.946ZDEBGoximeter (clickhouse-client): unrolling 255 total samples collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
5162026-03-20T19:29:48.958ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 126 table_name = fields_string
5172026-03-20T19:29:48.959ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 35 table_name = fields_u16
5182026-03-20T19:29:48.961ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 99 table_name = fields_uuid
5192026-03-20T19:29:48.962ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 160 table_name = measurements_cumulativeu64
5202026-03-20T19:29:48.964ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 35 table_name = measurements_histogramu64
5212026-03-20T19:29:48.965ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 60 table_name = measurements_u64
5222026-03-20T19:29:49.047ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
5232026-03-20T19:29:49.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5242026-03-20T19:29:49.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5252026-03-20T19:29:49.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5262026-03-20T19:29:49.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 2008c0d4-44f9-4d4a-898b-b779c0b99de7 producer_ip = fd00:1122:3344:101::2 producer_port = 62326
5272026-03-20T19:29:49.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 2008c0d4-44f9-4d4a-898b-b779c0b99de7 producer_ip = fd00:1122:3344:101::2 producer_port = 62326
5282026-03-20T19:29:49.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5292026-03-20T19:29:49.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5302026-03-20T19:29:49.456ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5312026-03-20T19:29:49.466ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2008c0d4-44f9-4d4a-898b-b779c0b99de7 producer_ip = fd00:1122:3344:101::2 producer_port = 62326
5322026-03-20T19:29:49.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5332026-03-20T19:29:49.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5342026-03-20T19:29:49.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5352026-03-20T19:29:50.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5362026-03-20T19:29:50.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5372026-03-20T19:29:50.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5382026-03-20T19:29:50.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5392026-03-20T19:29:50.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5402026-03-20T19:29:50.456ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5412026-03-20T19:29:50.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5422026-03-20T19:29:50.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5432026-03-20T19:29:50.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5442026-03-20T19:29:51.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5452026-03-20T19:29:51.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5462026-03-20T19:29:51.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5472026-03-20T19:29:51.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5482026-03-20T19:29:51.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5492026-03-20T19:29:51.456ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5502026-03-20T19:29:51.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5512026-03-20T19:29:51.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5522026-03-20T19:29:51.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5532026-03-20T19:29:52.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5542026-03-20T19:29:52.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5552026-03-20T19:29:52.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5562026-03-20T19:29:52.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5572026-03-20T19:29:52.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5582026-03-20T19:29:52.456ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5592026-03-20T19:29:52.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5602026-03-20T19:29:52.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5612026-03-20T19:29:52.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5622026-03-20T19:29:53.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5632026-03-20T19:29:53.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5642026-03-20T19:29:53.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5652026-03-20T19:29:53.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5662026-03-20T19:29:53.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5672026-03-20T19:29:53.456ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5682026-03-20T19:29:53.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5692026-03-20T19:29:53.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5702026-03-20T19:29:53.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5712026-03-20T19:29:53.946ZDEBGoximeter (results-sink): inserting 362 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
5722026-03-20T19:29:53.946ZDEBGoximeter (results-sink-cluster): inserting 362 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
5732026-03-20T19:29:53.946ZDEBGoximeter (clickhouse-client): unrolling 362 total samples collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
5742026-03-20T19:29:53.964ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 284 table_name = fields_i16
5752026-03-20T19:29:53.966ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 797 table_name = fields_string
5762026-03-20T19:29:53.968ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 142 table_name = fields_u16
5772026-03-20T19:29:53.969ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 149 table_name = fields_u32
5782026-03-20T19:29:53.971ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 148 table_name = fields_u8
5792026-03-20T19:29:53.972ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 490 table_name = fields_uuid
5802026-03-20T19:29:53.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 6 table_name = measurements_bool
5812026-03-20T19:29:53.975ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 265 table_name = measurements_cumulativeu64
5822026-03-20T19:29:53.976ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 1 table_name = measurements_f64
5832026-03-20T19:29:53.978ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 90 table_name = measurements_u64
5842026-03-20T19:29:54.047ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
5852026-03-20T19:29:54.437ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
5862026-03-20T19:29:54.437ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a7ae0e42-4671-47fd-a6f1-da0818409000/producers?sort_by=id_ascending
5872026-03-20T19:29:54.439ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a7ae0e42-4671-47fd-a6f1-da0818409000/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "19aeefa6-89e4-449d-84a6-0c0b640552dc", "content-length": "1136", "date": "Fri, 20 Mar 2026 19:29:54 GMT"} })
5882026-03-20T19:29:54.439ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a7ae0e42-4671-47fd-a6f1-da0818409000/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjM2Y1YmE2MC04ZTRkLTQ0ZDctODVlYy1hMjEyYmFlNjAyYzYifX0%3D
5892026-03-20T19:29:54.442ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a7ae0e42-4671-47fd-a6f1-da0818409000/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjM2Y1YmE2MC04ZTRkLTQ0ZDctODVlYy1hMjEyYmFlNjAyYzYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b8a9683-a9ac-4c83-8935-db8d2faaea2d", "content-length": "29", "date": "Fri, 20 Mar 2026 19:29:54 GMT"} })
5902026-03-20T19:29:54.442ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 7 n_pruned_tasks = 0
5912026-03-20T19:29:54.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 3a2f314d-2e3b-4a92-9b40-37a8b2efea1c producer_ip = fd00:1122:3344:101::1 producer_port = 33069
5922026-03-20T19:29:54.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5932026-03-20T19:29:54.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = c3f5ba60-8e4d-44d7-85ec-a212bae602c6 producer_ip = fd00:1122:3344:101::2 producer_port = 49140
5942026-03-20T19:29:54.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 3a2f314d-2e3b-4a92-9b40-37a8b2efea1c producer_ip = fd00:1122:3344:101::1 producer_port = 33069
5952026-03-20T19:29:54.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = c3f5ba60-8e4d-44d7-85ec-a212bae602c6 producer_ip = fd00:1122:3344:101::2 producer_port = 49140
5962026-03-20T19:29:54.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 064f1755-0a55-4fca-9bd7-ec0ae205759d producer_ip = fd00:1122:3344:101::c producer_port = 55827
5972026-03-20T19:29:54.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5982026-03-20T19:29:54.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 064f1755-0a55-4fca-9bd7-ec0ae205759d producer_ip = fd00:1122:3344:101::c producer_port = 55827
5992026-03-20T19:29:54.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6002026-03-20T19:29:54.452ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = c3f5ba60-8e4d-44d7-85ec-a212bae602c6 producer_ip = fd00:1122:3344:101::2 producer_port = 49140
6012026-03-20T19:29:54.453ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 064f1755-0a55-4fca-9bd7-ec0ae205759d producer_ip = fd00:1122:3344:101::c producer_port = 55827
6022026-03-20T19:29:54.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6032026-03-20T19:29:54.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6042026-03-20T19:29:54.455ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6052026-03-20T19:29:54.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6062026-03-20T19:29:54.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6072026-03-20T19:29:54.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6082026-03-20T19:29:54.514ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 3a2f314d-2e3b-4a92-9b40-37a8b2efea1c producer_ip = fd00:1122:3344:101::1 producer_port = 33069
6092026-03-20T19:29:54.518ZDEBGoximeter (results-sink-cluster): inserting 1551 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
6102026-03-20T19:29:54.519ZDEBGoximeter (results-sink): inserting 1551 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
6112026-03-20T19:29:54.519ZDEBGoximeter (clickhouse-client): unrolling 1551 total samples collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
6122026-03-20T19:29:54.582ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 2469 table_name = fields_string
6132026-03-20T19:29:54.584ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 43 table_name = fields_u16
6142026-03-20T19:29:54.585ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 801 table_name = fields_u32
6152026-03-20T19:29:54.587ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 1 table_name = fields_u64
6162026-03-20T19:29:54.589ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 1322 table_name = fields_uuid
6172026-03-20T19:29:54.591ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 1496 table_name = measurements_cumulativeu64
6182026-03-20T19:29:54.593ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 43 table_name = measurements_histogramu64
6192026-03-20T19:29:54.594ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 12 table_name = measurements_u64
6202026-03-20T19:29:54.619ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
6212026-03-20T19:29:55.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6222026-03-20T19:29:55.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6232026-03-20T19:29:55.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6242026-03-20T19:29:55.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6252026-03-20T19:29:55.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6262026-03-20T19:29:55.456ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6272026-03-20T19:29:55.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6282026-03-20T19:29:55.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6292026-03-20T19:29:55.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6302026-03-20T19:29:56.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6312026-03-20T19:29:56.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6322026-03-20T19:29:56.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6332026-03-20T19:29:56.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6342026-03-20T19:29:56.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6352026-03-20T19:29:56.456ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6362026-03-20T19:29:56.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6372026-03-20T19:29:56.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6382026-03-20T19:29:56.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6392026-03-20T19:29:57.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6402026-03-20T19:29:57.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6412026-03-20T19:29:57.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6422026-03-20T19:29:57.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6432026-03-20T19:29:57.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6442026-03-20T19:29:57.456ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6452026-03-20T19:29:57.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6462026-03-20T19:29:57.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6472026-03-20T19:29:57.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6482026-03-20T19:29:58.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6492026-03-20T19:29:58.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6502026-03-20T19:29:58.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6512026-03-20T19:29:58.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6522026-03-20T19:29:58.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6532026-03-20T19:29:58.456ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6542026-03-20T19:29:58.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6552026-03-20T19:29:58.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6562026-03-20T19:29:58.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6572026-03-20T19:29:58.946ZDEBGoximeter (results-sink): inserting 176 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
6582026-03-20T19:29:58.946ZDEBGoximeter (results-sink-cluster): inserting 176 samples into database collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d
6592026-03-20T19:29:58.946ZDEBGoximeter (clickhouse-client): unrolling 176 total samples collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde
6602026-03-20T19:29:58.956ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 56 table_name = fields_string
6612026-03-20T19:29:58.957ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 64 table_name = fields_uuid
6622026-03-20T19:29:58.959ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 128 table_name = measurements_cumulativeu64
6632026-03-20T19:29:58.960ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d id = 90dae5a5-7bad-4ae4-b1a5-513942aa2cde n_rows = 48 table_name = measurements_u64
6642026-03-20T19:29:59.047ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
6652026-03-20T19:29:59.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6662026-03-20T19:29:59.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6672026-03-20T19:29:59.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6682026-03-20T19:29:59.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 2008c0d4-44f9-4d4a-898b-b779c0b99de7 producer_ip = fd00:1122:3344:101::2 producer_port = 62326
6692026-03-20T19:29:59.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 2008c0d4-44f9-4d4a-898b-b779c0b99de7 producer_ip = fd00:1122:3344:101::2 producer_port = 62326
6702026-03-20T19:29:59.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6712026-03-20T19:29:59.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6722026-03-20T19:29:59.455ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6732026-03-20T19:29:59.465ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2008c0d4-44f9-4d4a-898b-b779c0b99de7 producer_ip = fd00:1122:3344:101::2 producer_port = 62326
6742026-03-20T19:29:59.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6752026-03-20T19:29:59.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6762026-03-20T19:29:59.484ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6772026-03-20T19:30:00.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6782026-03-20T19:30:00.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6792026-03-20T19:30:00.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6802026-03-20T19:30:00.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6812026-03-20T19:30:00.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6822026-03-20T19:30:00.456ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6832026-03-20T19:30:00.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6842026-03-20T19:30:00.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6852026-03-20T19:30:00.487ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6862026-03-20T19:30:01.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6872026-03-20T19:30:01.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6882026-03-20T19:30:01.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6892026-03-20T19:30:01.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6902026-03-20T19:30:01.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6912026-03-20T19:30:01.456ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6922026-03-20T19:30:01.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6932026-03-20T19:30:01.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6942026-03-20T19:30:01.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6952026-03-20T19:30:02.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6962026-03-20T19:30:02.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6972026-03-20T19:30:02.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6982026-03-20T19:30:02.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6992026-03-20T19:30:02.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7002026-03-20T19:30:02.456ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7012026-03-20T19:30:02.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7022026-03-20T19:30:02.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7032026-03-20T19:30:02.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7042026-03-20T19:30:03.450ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7052026-03-20T19:30:03.450ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7062026-03-20T19:30:03.451ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bb2f1638-9094-4597-8649-22d8f9de2dd9 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7072026-03-20T19:30:03.454ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7082026-03-20T19:30:03.454ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7092026-03-20T19:30:03.455ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 33817fde-0630-4cce-aeab-497dd0fcae1c producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7102026-03-20T19:30:03.482ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7112026-03-20T19:30:03.482ZDEBGoximeter (collection-task): collecting from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7122026-03-20T19:30:03.485ZDEBGoximeter (collection-task): collected results from producer collector_id = a7ae0e42-4671-47fd-a6f1-da0818409000 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0464327c-b131-47a4-8d96-2c27a1e28cbc producer_ip = fd00:1122:3344:101::1 producer_port = 8001