Max level shown:
1 [ Mar 18 21:13:11 Enabled. ]
2 [ Mar 18 21:13:11 Rereading configuration. ]
3 [ Mar 18 21:13:13 Rereading configuration. ]
4 [ Mar 18 21:13:19 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id ac48f1de-dedf-4f48-a035-c424ed2ee7b0 &"). ]
5 [ Mar 18 21:13:19 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-03-18T21:13:19.638ZDEBGoximeter: registered DTrace probes
82026-03-18T21:13:19.640ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:265
92026-03-18T21:13:19.643ZDEBGoximeter: creating ClickHouse client
102026-03-18T21:13:19.681ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
112026-03-18T21:13:22.934ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:900 id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
122026-03-18T21:13:22.934ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
132026-03-18T21:13:22.934ZINFOoximeter (clickhouse-client): reading db version collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:800 id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
142026-03-18T21:13:22.936ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:900 id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
152026-03-18T21:13:22.936ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:805 id = 501ab625-5e61-4733-a6dc-35b48e9d14cd version = 0
162026-03-18T21:13:22.936ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:810 id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
172026-03-18T21:13:22.936ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
182026-03-18T21:13:23.142ZINFOoximeter (clickhouse-client): inserting current version collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:831 id = 501ab625-5e61-4733-a6dc-35b48e9d14cd version = 14
192026-03-18T21:13:23.160ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = df4b3a5b-73d6-4ac9-a88d-790923b92098
202026-03-18T21:13:23.176ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-03-18T21:13:23.176ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-03-18T21:13:23.176ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-03-18T21:13:23.176ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-03-18T21:13:23.176ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::d]:12223
252026-03-18T21:13:23.183ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-03-18T21:13:23.183ZDEBGoximeter: registered USDT probes
272026-03-18T21:13:23.183ZDEBGoximeter: contacting nexus
282026-03-18T21:13:23.232ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
292026-03-18T21:13:23.233ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
302026-03-18T21:13:23.233ZWARNoximeter: failed to contact nexus, will retry in 248.37281ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:410
312026-03-18T21:13:23.483ZDEBGoximeter: contacting nexus
322026-03-18T21:13:23.483ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
332026-03-18T21:13:23.483ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::c]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
342026-03-18T21:13:23.483ZWARNoximeter: failed to contact nexus, will retry in 332.664137ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:410
352026-03-18T21:13:23.816ZDEBGoximeter: contacting nexus
362026-03-18T21:13:23.816ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
372026-03-18T21:13:23.816ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::c]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
382026-03-18T21:13:23.816ZWARNoximeter: failed to contact nexus, will retry in 922.65536ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:410
392026-03-18T21:13:24.741ZDEBGoximeter: contacting nexus
402026-03-18T21:13:24.741ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
412026-03-18T21:13:24.741ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
422026-03-18T21:13:24.741ZWARNoximeter: failed to contact nexus, will retry in 2.245233246s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:410
432026-03-18T21:13:26.987ZDEBGoximeter: contacting nexus
442026-03-18T21:13:26.987ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
452026-03-18T21:13:27.151ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "daa47203-a4c4-4252-a8ce-7ecad09ff872", "date": "Wed, 18 Mar 2026 21:13:27 GMT"} })
462026-03-18T21:13:27.153ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:428 id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0
472026-03-18T21:13:27.153ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:554
482026-03-18T21:13:27.154ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
492026-03-18T21:13:27.154ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?sort_by=id_ascending
502026-03-18T21:13:27.154ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?sort_by=id_ascending", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
512026-03-18T21:13:27.156ZERROoximeter (oximeter-agent): error fetching next assigned producer, abandoning this refresh attempt collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?sort_by=id_ascending): error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?sort_by=id_ascending): client error (Connect): tcp connect error: Connection refused (os error 146) file = oximeter/collector/src/agent.rs:595
522026-03-18T21:13:42.153ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
532026-03-18T21:13:42.153ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?sort_by=id_ascending
542026-03-18T21:13:42.163ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f78bdea-1d0b-417b-96d4-da748af4a2b3", "content-length": "300", "date": "Wed, 18 Mar 2026 21:13:42 GMT"} })
552026-03-18T21:13:42.171ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiIyMThkOGI5NC03YTIyLTQzMDYtYWFkNy1kNWEyNDMxMWUzMDEifX0%3D
562026-03-18T21:13:42.181ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiIyMThkOGI5NC03YTIyLTQzMDYtYWFkNy1kNWEyNDMxMWUzMDEifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "6aea3748-6dbc-45b6-a327-2518485b9064", "content-length": "29", "date": "Wed, 18 Mar 2026 21:13:42 GMT"} })
572026-03-18T21:13:42.181ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:36013 collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301
582026-03-18T21:13:42.183ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 1 n_pruned_tasks = 0
592026-03-18T21:13:42.184ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
602026-03-18T21:13:42.217ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
612026-03-18T21:13:42.217ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
622026-03-18T21:13:42.228ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
632026-03-18T21:13:43.162ZDEBGoximeter (results-sink): inserting 16 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
642026-03-18T21:13:43.162ZDEBGoximeter (results-sink-cluster): inserting 16 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
652026-03-18T21:13:43.162ZDEBGoximeter (clickhouse-client): unrolling 16 total samples collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
662026-03-18T21:13:43.162ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
672026-03-18T21:13:43.169ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:13:43.162411660Z } timeseries_name = oximeter_collector:collections
682026-03-18T21:13:43.187ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
692026-03-18T21:13:43.199ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:13:43.187510153Z } timeseries_name = http_service:request_latency_histogram
702026-03-18T21:13:43.200ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
712026-03-18T21:13:43.205ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:13:43.200001054Z } timeseries_name = collection_target:cpus_provisioned
722026-03-18T21:13:43.205ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
732026-03-18T21:13:43.206ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:13:43.205202004Z } timeseries_name = collection_target:ram_provisioned
742026-03-18T21:13:43.206ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
752026-03-18T21:13:43.206ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:13:43.206128446Z } timeseries_name = collection_target:virtual_disk_space_provisioned
762026-03-18T21:13:43.207ZDEBGoximeter (clickhouse-client): inserting 5 new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
772026-03-18T21:13:43.219ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 2 table_name = fields_ipaddr
782026-03-18T21:13:43.221ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 19 table_name = fields_string
792026-03-18T21:13:43.223ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 11 table_name = fields_u16
802026-03-18T21:13:43.224ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 17 table_name = fields_uuid
812026-03-18T21:13:43.228ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 1 table_name = measurements_cumulativeu64
822026-03-18T21:13:43.233ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 9 table_name = measurements_histogramu64
832026-03-18T21:13:43.235ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 6 table_name = measurements_i64
842026-03-18T21:13:43.262ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
852026-03-18T21:13:52.184ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
862026-03-18T21:13:52.184ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
872026-03-18T21:13:52.188ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
882026-03-18T21:13:53.162ZDEBGoximeter (results-sink): inserting 34 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
892026-03-18T21:13:53.162ZDEBGoximeter (results-sink-cluster): inserting 34 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
902026-03-18T21:13:53.162ZDEBGoximeter (clickhouse-client): unrolling 34 total samples collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
912026-03-18T21:13:53.168ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 44 table_name = fields_string
922026-03-18T21:13:53.170ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 22 table_name = fields_u16
932026-03-18T21:13:53.172ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 28 table_name = fields_uuid
942026-03-18T21:13:53.175ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 22 table_name = measurements_histogramu64
952026-03-18T21:13:53.179ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 12 table_name = measurements_i64
962026-03-18T21:13:53.262ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
972026-03-18T21:13:57.153ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
982026-03-18T21:13:57.153ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?sort_by=id_ascending
992026-03-18T21:13:57.153ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?sort_by=id_ascending", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
1002026-03-18T21:13:57.153ZERROoximeter (oximeter-agent): error fetching next assigned producer, abandoning this refresh attempt collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?sort_by=id_ascending): error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?sort_by=id_ascending): client error (Connect): tcp connect error: Connection refused (os error 146) file = oximeter/collector/src/agent.rs:595
1012026-03-18T21:14:02.184ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
1022026-03-18T21:14:02.184ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
1032026-03-18T21:14:02.188ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
1042026-03-18T21:14:03.161ZDEBGoximeter (results-sink): inserting 24 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
1052026-03-18T21:14:03.161ZDEBGoximeter (results-sink-cluster): inserting 24 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
1062026-03-18T21:14:03.161ZDEBGoximeter (clickhouse-client): unrolling 24 total samples collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1072026-03-18T21:14:03.165ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 48 table_name = fields_string
1082026-03-18T21:14:03.167ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 24 table_name = fields_u16
1092026-03-18T21:14:03.169ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 24 table_name = fields_uuid
1102026-03-18T21:14:03.172ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 24 table_name = measurements_histogramu64
1112026-03-18T21:14:03.262ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
1122026-03-18T21:14:12.154ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
1132026-03-18T21:14:12.154ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?sort_by=id_ascending
1142026-03-18T21:14:12.163ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a9bbf4c-a3b4-472f-bd8f-af3b8a6bd5dd", "content-length": "851", "date": "Wed, 18 Mar 2026 21:14:12 GMT"} })
1152026-03-18T21:14:12.163ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzU1MzRkYi1iYWMyLTQzYTMtODhhOS1lM2ZiMjRkODgyODMifX0%3D
1162026-03-18T21:14:12.166ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzU1MzRkYi1iYWMyLTQzYTMtODhhOS1lM2ZiMjRkODgyODMifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "24f9122c-cbe7-4eb5-915e-0985c965074d", "content-length": "29", "date": "Wed, 18 Mar 2026 21:14:12 GMT"} })
1172026-03-18T21:14:12.167ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090
1182026-03-18T21:14:12.167ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:53473 collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 813cfaf6-f373-4a92-9eb9-18556a45526d
1192026-03-18T21:14:12.167ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3
1202026-03-18T21:14:12.167ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:47848 collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = ec5534db-bac2-43a3-88a9-e3fb24d88283
1212026-03-18T21:14:12.167ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 5 n_pruned_tasks = 0
1222026-03-18T21:14:12.168ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 813cfaf6-f373-4a92-9eb9-18556a45526d producer_ip = fd00:1122:3344:101::2 producer_port = 53473
1232026-03-18T21:14:12.168ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1242026-03-18T21:14:12.168ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1252026-03-18T21:14:12.168ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = ec5534db-bac2-43a3-88a9-e3fb24d88283 producer_ip = fd00:1122:3344:101::1 producer_port = 47848
1262026-03-18T21:14:12.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = ec5534db-bac2-43a3-88a9-e3fb24d88283 producer_ip = fd00:1122:3344:101::1 producer_port = 47848
1272026-03-18T21:14:12.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1282026-03-18T21:14:12.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 813cfaf6-f373-4a92-9eb9-18556a45526d producer_ip = fd00:1122:3344:101::2 producer_port = 53473
1292026-03-18T21:14:12.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1302026-03-18T21:14:12.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 813cfaf6-f373-4a92-9eb9-18556a45526d producer_ip = fd00:1122:3344:101::2 producer_port = 53473
1312026-03-18T21:14:12.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = ec5534db-bac2-43a3-88a9-e3fb24d88283 producer_ip = fd00:1122:3344:101::1 producer_port = 47848
1322026-03-18T21:14:12.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1332026-03-18T21:14:12.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1342026-03-18T21:14:12.179ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1352026-03-18T21:14:12.181ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1362026-03-18T21:14:12.185ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
1372026-03-18T21:14:12.185ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
1382026-03-18T21:14:12.188ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
1392026-03-18T21:14:12.195ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 813cfaf6-f373-4a92-9eb9-18556a45526d producer_ip = fd00:1122:3344:101::2 producer_port = 53473
1402026-03-18T21:14:12.295ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = ec5534db-bac2-43a3-88a9-e3fb24d88283 producer_ip = fd00:1122:3344:101::1 producer_port = 47848
1412026-03-18T21:14:12.308ZDEBGoximeter (results-sink): inserting 2656 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
1422026-03-18T21:14:12.308ZDEBGoximeter (clickhouse-client): unrolling 2656 total samples collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1432026-03-18T21:14:12.308ZDEBGoximeter (results-sink-cluster): inserting 2656 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
1442026-03-18T21:14:12.308ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1452026-03-18T21:14:12.331ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.308525873Z } timeseries_name = ddm_router:originated_underlay_prefixes
1462026-03-18T21:14:12.331ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1472026-03-18T21:14:12.333ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.331660171Z } timeseries_name = ddm_router:originated_tunnel_endpoints
1482026-03-18T21:14:12.333ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1492026-03-18T21:14:12.334ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.333426432Z } timeseries_name = ddm_session:solicitations_sent
1502026-03-18T21:14:12.334ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1512026-03-18T21:14:12.336ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.334814394Z } timeseries_name = ddm_session:solicitations_received
1522026-03-18T21:14:12.336ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1532026-03-18T21:14:12.337ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.336154035Z } timeseries_name = ddm_session:advertisements_sent
1542026-03-18T21:14:12.337ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1552026-03-18T21:14:12.338ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.337487266Z } timeseries_name = ddm_session:advertisements_received
1562026-03-18T21:14:12.338ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1572026-03-18T21:14:12.340ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.338821557Z } timeseries_name = ddm_session:peer_expirations
1582026-03-18T21:14:12.340ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1592026-03-18T21:14:12.341ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.340142728Z } timeseries_name = ddm_session:peer_address_changes
1602026-03-18T21:14:12.341ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1612026-03-18T21:14:12.342ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.341456378Z } timeseries_name = ddm_session:peer_sessions_established
1622026-03-18T21:14:12.342ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1632026-03-18T21:14:12.344ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.342785879Z } timeseries_name = ddm_session:updates_sent
1642026-03-18T21:14:12.344ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1652026-03-18T21:14:12.345ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.344440468Z } timeseries_name = ddm_session:updates_received
1662026-03-18T21:14:12.345ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1672026-03-18T21:14:12.347ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.345895851Z } timeseries_name = ddm_session:update_send_fail
1682026-03-18T21:14:12.347ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1692026-03-18T21:14:12.348ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.347350405Z } timeseries_name = ddm_session:imported_underlay_prefixes
1702026-03-18T21:14:12.348ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1712026-03-18T21:14:12.350ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.348794229Z } timeseries_name = ddm_session:imported_tunnel_endpoints
1722026-03-18T21:14:12.352ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1732026-03-18T21:14:12.354ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.352831572Z } timeseries_name = switch_data_link:link_enabled
1742026-03-18T21:14:12.356ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1752026-03-18T21:14:12.358ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.356734443Z } timeseries_name = switch_data_link:link_up
1762026-03-18T21:14:12.358ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1772026-03-18T21:14:12.360ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.358638918Z } timeseries_name = switch_table:capacity
1782026-03-18T21:14:12.360ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1792026-03-18T21:14:12.361ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.360140042Z } timeseries_name = switch_table:occupancy
1802026-03-18T21:14:12.361ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1812026-03-18T21:14:12.363ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.361727739Z } timeseries_name = switch_table:inserts
1822026-03-18T21:14:12.363ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1832026-03-18T21:14:12.364ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.363205634Z } timeseries_name = switch_table:deletes
1842026-03-18T21:14:12.364ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1852026-03-18T21:14:12.366ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.364686468Z } timeseries_name = switch_table:updates
1862026-03-18T21:14:12.366ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1872026-03-18T21:14:12.367ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.366161042Z } timeseries_name = switch_table:collisions
1882026-03-18T21:14:12.367ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1892026-03-18T21:14:12.369ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.367771530Z } timeseries_name = switch_table:update_misses
1902026-03-18T21:14:12.369ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1912026-03-18T21:14:12.370ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.369246714Z } timeseries_name = switch_table:delete_misses
1922026-03-18T21:14:12.370ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1932026-03-18T21:14:12.372ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.370730548Z } timeseries_name = switch_table:exhaustion
1942026-03-18T21:14:12.379ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1952026-03-18T21:14:12.381ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.379831080Z } timeseries_name = dendrite:sample_collection_duration
1962026-03-18T21:14:12.381ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1972026-03-18T21:14:12.383ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.381896788Z } timeseries_name = sled_data_link:errors_received
1982026-03-18T21:14:12.383ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
1992026-03-18T21:14:12.385ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.383481945Z } timeseries_name = sled_data_link:errors_sent
2002026-03-18T21:14:12.385ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
2012026-03-18T21:14:12.386ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.385108222Z } timeseries_name = sled_data_link:bytes_received
2022026-03-18T21:14:12.386ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
2032026-03-18T21:14:12.388ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.386741580Z } timeseries_name = sled_data_link:packets_received
2042026-03-18T21:14:12.388ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
2052026-03-18T21:14:12.389ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.388347548Z } timeseries_name = sled_data_link:bytes_sent
2062026-03-18T21:14:12.389ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
2072026-03-18T21:14:12.391ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.389963265Z } timeseries_name = sled_data_link:packets_sent
2082026-03-18T21:14:12.409ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
2092026-03-18T21:14:12.462ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
2102026-03-18T21:14:12.464ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_cpu:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "cpu_id", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.462355837Z } timeseries_name = sled_cpu:cpu_nsec
2112026-03-18T21:14:12.487ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
2122026-03-18T21:14:12.489ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("kstat_sampler:expired_targets"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.487635035Z } timeseries_name = kstat_sampler:expired_targets
2132026-03-18T21:14:12.490ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
2142026-03-18T21:14:12.491ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("kstat_sampler:samples_dropped"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "target_id", field_type: U64, source: Metric, description: "" }, FieldSchema { name: "target_name", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:12.490096892Z } timeseries_name = kstat_sampler:samples_dropped
2152026-03-18T21:14:12.492ZDEBGoximeter (clickhouse-client): inserting 35 new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
2162026-03-18T21:14:12.498ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 284 table_name = fields_i16
2172026-03-18T21:14:12.499ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 8 table_name = fields_ipaddr
2182026-03-18T21:14:12.502ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 2732 table_name = fields_string
2192026-03-18T21:14:12.504ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 186 table_name = fields_u16
2202026-03-18T21:14:12.506ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 857 table_name = fields_u32
2212026-03-18T21:14:12.507ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 1 table_name = fields_u64
2222026-03-18T21:14:12.509ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 148 table_name = fields_u8
2232026-03-18T21:14:12.511ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 1462 table_name = fields_uuid
2242026-03-18T21:14:12.513ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 6 table_name = measurements_bool
2252026-03-18T21:14:12.515ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 2573 table_name = measurements_cumulativeu64
2262026-03-18T21:14:12.516ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 1 table_name = measurements_f64
2272026-03-18T21:14:12.518ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 36 table_name = measurements_histogramu64
2282026-03-18T21:14:12.520ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 40 table_name = measurements_u64
2292026-03-18T21:14:13.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2302026-03-18T21:14:13.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2312026-03-18T21:14:13.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2322026-03-18T21:14:13.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2332026-03-18T21:14:13.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2342026-03-18T21:14:13.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2352026-03-18T21:14:14.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2362026-03-18T21:14:14.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2372026-03-18T21:14:14.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2382026-03-18T21:14:14.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2392026-03-18T21:14:14.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2402026-03-18T21:14:14.171ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2412026-03-18T21:14:15.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2422026-03-18T21:14:15.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2432026-03-18T21:14:15.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2442026-03-18T21:14:15.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2452026-03-18T21:14:15.168ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2462026-03-18T21:14:15.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2472026-03-18T21:14:16.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2482026-03-18T21:14:16.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2492026-03-18T21:14:16.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2502026-03-18T21:14:16.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2512026-03-18T21:14:16.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2522026-03-18T21:14:16.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2532026-03-18T21:14:17.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2542026-03-18T21:14:17.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2552026-03-18T21:14:17.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2562026-03-18T21:14:17.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2572026-03-18T21:14:17.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2582026-03-18T21:14:17.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2592026-03-18T21:14:18.162ZDEBGoximeter (results-sink): inserting 200 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
2602026-03-18T21:14:18.162ZDEBGoximeter (results-sink-cluster): inserting 200 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
2612026-03-18T21:14:18.162ZDEBGoximeter (clickhouse-client): unrolling 200 total samples collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
2622026-03-18T21:14:18.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2632026-03-18T21:14:18.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2642026-03-18T21:14:18.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2652026-03-18T21:14:18.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2662026-03-18T21:14:18.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2672026-03-18T21:14:18.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2682026-03-18T21:14:18.171ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 52 table_name = fields_string
2692026-03-18T21:14:18.172ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 56 table_name = fields_uuid
2702026-03-18T21:14:18.174ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 150 table_name = measurements_cumulativeu64
2712026-03-18T21:14:18.175ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 50 table_name = measurements_u64
2722026-03-18T21:14:18.262ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
2732026-03-18T21:14:19.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2742026-03-18T21:14:19.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2752026-03-18T21:14:19.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2762026-03-18T21:14:19.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2772026-03-18T21:14:19.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2782026-03-18T21:14:19.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2792026-03-18T21:14:20.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2802026-03-18T21:14:20.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2812026-03-18T21:14:20.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2822026-03-18T21:14:20.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2832026-03-18T21:14:20.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2842026-03-18T21:14:20.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2852026-03-18T21:14:21.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2862026-03-18T21:14:21.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2872026-03-18T21:14:21.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2882026-03-18T21:14:21.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2892026-03-18T21:14:21.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2902026-03-18T21:14:21.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2912026-03-18T21:14:22.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 813cfaf6-f373-4a92-9eb9-18556a45526d producer_ip = fd00:1122:3344:101::2 producer_port = 53473
2922026-03-18T21:14:22.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 813cfaf6-f373-4a92-9eb9-18556a45526d producer_ip = fd00:1122:3344:101::2 producer_port = 53473
2932026-03-18T21:14:22.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2942026-03-18T21:14:22.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2952026-03-18T21:14:22.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2962026-03-18T21:14:22.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2972026-03-18T21:14:22.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2982026-03-18T21:14:22.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2992026-03-18T21:14:22.180ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 813cfaf6-f373-4a92-9eb9-18556a45526d producer_ip = fd00:1122:3344:101::2 producer_port = 53473
3002026-03-18T21:14:22.184ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
3012026-03-18T21:14:22.184ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
3022026-03-18T21:14:22.188ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
3032026-03-18T21:14:23.162ZDEBGoximeter (results-sink): inserting 367 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
3042026-03-18T21:14:23.162ZDEBGoximeter (results-sink-cluster): inserting 367 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
3052026-03-18T21:14:23.162ZDEBGoximeter (clickhouse-client): unrolling 367 total samples collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
3062026-03-18T21:14:23.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3072026-03-18T21:14:23.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3082026-03-18T21:14:23.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3092026-03-18T21:14:23.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3102026-03-18T21:14:23.168ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3112026-03-18T21:14:23.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3122026-03-18T21:14:23.180ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 284 table_name = fields_i16
3132026-03-18T21:14:23.182ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 843 table_name = fields_string
3142026-03-18T21:14:23.184ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 167 table_name = fields_u16
3152026-03-18T21:14:23.185ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 149 table_name = fields_u32
3162026-03-18T21:14:23.187ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 148 table_name = fields_u8
3172026-03-18T21:14:23.189ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 507 table_name = fields_uuid
3182026-03-18T21:14:23.190ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 6 table_name = measurements_bool
3192026-03-18T21:14:23.191ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 255 table_name = measurements_cumulativeu64
3202026-03-18T21:14:23.193ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 1 table_name = measurements_f64
3212026-03-18T21:14:23.195ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 25 table_name = measurements_histogramu64
3222026-03-18T21:14:23.196ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 80 table_name = measurements_u64
3232026-03-18T21:14:23.263ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
3242026-03-18T21:14:24.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3252026-03-18T21:14:24.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3262026-03-18T21:14:24.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3272026-03-18T21:14:24.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3282026-03-18T21:14:24.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3292026-03-18T21:14:24.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3302026-03-18T21:14:25.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3312026-03-18T21:14:25.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3322026-03-18T21:14:25.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3332026-03-18T21:14:25.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3342026-03-18T21:14:25.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3352026-03-18T21:14:25.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3362026-03-18T21:14:26.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3372026-03-18T21:14:26.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3382026-03-18T21:14:26.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3392026-03-18T21:14:26.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3402026-03-18T21:14:26.168ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3412026-03-18T21:14:26.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3422026-03-18T21:14:27.154ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
3432026-03-18T21:14:27.154ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?sort_by=id_ascending
3442026-03-18T21:14:27.158ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "16db8efc-3f50-42f9-854f-1d00ccdab8f8", "content-length": "851", "date": "Wed, 18 Mar 2026 21:14:27 GMT"} })
3452026-03-18T21:14:27.158ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzU1MzRkYi1iYWMyLTQzYTMtODhhOS1lM2ZiMjRkODgyODMifX0%3D
3462026-03-18T21:14:27.161ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzU1MzRkYi1iYWMyLTQzYTMtODhhOS1lM2ZiMjRkODgyODMifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa6c6bb8-9c9f-4f14-bf7d-406ada9dbded", "content-length": "29", "date": "Wed, 18 Mar 2026 21:14:27 GMT"} })
3472026-03-18T21:14:27.161ZDEBGoximeter (oximeter-agent): received request to register existing metric producer, updating collection information address = [fd00:1122:3344:101::2]:52006 collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d interval = 30s producer_id = 813cfaf6-f373-4a92-9eb9-18556a45526d
3482026-03-18T21:14:27.161ZDEBGoximeter (collection-task-handle): notified collection task of new producer endpoint collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 813cfaf6-f373-4a92-9eb9-18556a45526d producer_ip = fd00:1122:3344:101::2 producer_port = 53473
3492026-03-18T21:14:27.161ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 5 n_pruned_tasks = 0
3502026-03-18T21:14:27.161ZDEBGoximeter (collection-task): collection task received request to update its producer information address = [fd00:1122:3344:101::2]:52006 collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d interval = 30s producer_id = 813cfaf6-f373-4a92-9eb9-18556a45526d producer_ip = fd00:1122:3344:101::2 producer_port = 53473
3512026-03-18T21:14:27.162ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 813cfaf6-f373-4a92-9eb9-18556a45526d producer_ip = fd00:1122:3344:101::2 producer_port = 53473
3522026-03-18T21:14:27.162ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 813cfaf6-f373-4a92-9eb9-18556a45526d producer_ip = fd00:1122:3344:101::2 producer_port = 53473
3532026-03-18T21:14:27.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3542026-03-18T21:14:27.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3552026-03-18T21:14:27.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3562026-03-18T21:14:27.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3572026-03-18T21:14:27.168ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3582026-03-18T21:14:27.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3592026-03-18T21:14:27.210ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 813cfaf6-f373-4a92-9eb9-18556a45526d producer_ip = fd00:1122:3344:101::2 producer_port = 53473
3602026-03-18T21:14:28.161ZDEBGoximeter (results-sink): inserting 536 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
3612026-03-18T21:14:28.161ZDEBGoximeter (results-sink-cluster): inserting 536 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
3622026-03-18T21:14:28.161ZDEBGoximeter (clickhouse-client): unrolling 536 total samples collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
3632026-03-18T21:14:28.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3642026-03-18T21:14:28.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3652026-03-18T21:14:28.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3662026-03-18T21:14:28.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3672026-03-18T21:14:28.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3682026-03-18T21:14:28.169ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
3692026-03-18T21:14:28.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3702026-03-18T21:14:28.174ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:28.169949193Z } timeseries_name = switch_port_control_data_link:errors_received
3712026-03-18T21:14:28.174ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
3722026-03-18T21:14:28.176ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:28.174769205Z } timeseries_name = switch_port_control_data_link:errors_sent
3732026-03-18T21:14:28.176ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
3742026-03-18T21:14:28.178ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:28.176875924Z } timeseries_name = switch_port_control_data_link:bytes_received
3752026-03-18T21:14:28.178ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
3762026-03-18T21:14:28.180ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:28.178814899Z } timeseries_name = switch_port_control_data_link:packets_received
3772026-03-18T21:14:28.180ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
3782026-03-18T21:14:28.182ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:28.180738654Z } timeseries_name = switch_port_control_data_link:bytes_sent
3792026-03-18T21:14:28.182ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
3802026-03-18T21:14:28.184ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:28.182871343Z } timeseries_name = switch_port_control_data_link:packets_sent
3812026-03-18T21:14:28.198ZDEBGoximeter (clickhouse-client): inserting 6 new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
3822026-03-18T21:14:28.201ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 24 table_name = fields_i16
3832026-03-18T21:14:28.203ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 172 table_name = fields_string
3842026-03-18T21:14:28.204ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 12 table_name = fields_u16
3852026-03-18T21:14:28.205ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 24 table_name = fields_u32
3862026-03-18T21:14:28.207ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 12 table_name = fields_u8
3872026-03-18T21:14:28.208ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 92 table_name = fields_uuid
3882026-03-18T21:14:28.210ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 486 table_name = measurements_cumulativeu64
3892026-03-18T21:14:28.211ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 50 table_name = measurements_u64
3902026-03-18T21:14:28.262ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
3912026-03-18T21:14:29.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3922026-03-18T21:14:29.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3932026-03-18T21:14:29.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3942026-03-18T21:14:29.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3952026-03-18T21:14:29.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3962026-03-18T21:14:29.171ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3972026-03-18T21:14:30.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3982026-03-18T21:14:30.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3992026-03-18T21:14:30.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4002026-03-18T21:14:30.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4012026-03-18T21:14:30.168ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4022026-03-18T21:14:30.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4032026-03-18T21:14:31.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4042026-03-18T21:14:31.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4052026-03-18T21:14:31.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4062026-03-18T21:14:31.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4072026-03-18T21:14:31.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4082026-03-18T21:14:31.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4092026-03-18T21:14:32.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4102026-03-18T21:14:32.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4112026-03-18T21:14:32.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4122026-03-18T21:14:32.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4132026-03-18T21:14:32.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4142026-03-18T21:14:32.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4152026-03-18T21:14:32.185ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
4162026-03-18T21:14:32.185ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
4172026-03-18T21:14:32.188ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
4182026-03-18T21:14:33.162ZDEBGoximeter (results-sink): inserting 225 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
4192026-03-18T21:14:33.162ZDEBGoximeter (results-sink-cluster): inserting 225 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
4202026-03-18T21:14:33.162ZDEBGoximeter (clickhouse-client): unrolling 225 total samples collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
4212026-03-18T21:14:33.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4222026-03-18T21:14:33.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4232026-03-18T21:14:33.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4242026-03-18T21:14:33.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4252026-03-18T21:14:33.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4262026-03-18T21:14:33.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4272026-03-18T21:14:33.173ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 102 table_name = fields_string
4282026-03-18T21:14:33.174ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 25 table_name = fields_u16
4292026-03-18T21:14:33.176ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 81 table_name = fields_uuid
4302026-03-18T21:14:33.177ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 150 table_name = measurements_cumulativeu64
4312026-03-18T21:14:33.179ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 25 table_name = measurements_histogramu64
4322026-03-18T21:14:33.181ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 50 table_name = measurements_u64
4332026-03-18T21:14:33.262ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
4342026-03-18T21:14:34.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4352026-03-18T21:14:34.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4362026-03-18T21:14:34.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4372026-03-18T21:14:34.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4382026-03-18T21:14:34.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4392026-03-18T21:14:34.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4402026-03-18T21:14:35.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4412026-03-18T21:14:35.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4422026-03-18T21:14:35.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4432026-03-18T21:14:35.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4442026-03-18T21:14:35.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4452026-03-18T21:14:35.171ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4462026-03-18T21:14:36.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4472026-03-18T21:14:36.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4482026-03-18T21:14:36.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4492026-03-18T21:14:36.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4502026-03-18T21:14:36.168ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4512026-03-18T21:14:36.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4522026-03-18T21:14:37.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4532026-03-18T21:14:37.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4542026-03-18T21:14:37.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4552026-03-18T21:14:37.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4562026-03-18T21:14:37.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4572026-03-18T21:14:37.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4582026-03-18T21:14:38.161ZDEBGoximeter (results-sink): inserting 200 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
4592026-03-18T21:14:38.161ZDEBGoximeter (results-sink-cluster): inserting 200 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
4602026-03-18T21:14:38.161ZDEBGoximeter (clickhouse-client): unrolling 200 total samples collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
4612026-03-18T21:14:38.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4622026-03-18T21:14:38.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4632026-03-18T21:14:38.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4642026-03-18T21:14:38.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4652026-03-18T21:14:38.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4662026-03-18T21:14:38.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4672026-03-18T21:14:38.170ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 52 table_name = fields_string
4682026-03-18T21:14:38.172ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 56 table_name = fields_uuid
4692026-03-18T21:14:38.173ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 150 table_name = measurements_cumulativeu64
4702026-03-18T21:14:38.174ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 50 table_name = measurements_u64
4712026-03-18T21:14:38.263ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
4722026-03-18T21:14:39.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4732026-03-18T21:14:39.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4742026-03-18T21:14:39.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4752026-03-18T21:14:39.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4762026-03-18T21:14:39.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4772026-03-18T21:14:39.171ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4782026-03-18T21:14:40.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4792026-03-18T21:14:40.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4802026-03-18T21:14:40.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4812026-03-18T21:14:40.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4822026-03-18T21:14:40.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4832026-03-18T21:14:40.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4842026-03-18T21:14:41.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4852026-03-18T21:14:41.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4862026-03-18T21:14:41.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4872026-03-18T21:14:41.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4882026-03-18T21:14:41.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4892026-03-18T21:14:41.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4902026-03-18T21:14:42.153ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
4912026-03-18T21:14:42.153ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?sort_by=id_ascending
4922026-03-18T21:14:42.153ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?sort_by=id_ascending", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
4932026-03-18T21:14:42.153ZERROoximeter (oximeter-agent): error fetching next assigned producer, abandoning this refresh attempt collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?sort_by=id_ascending): error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?sort_by=id_ascending): client error (Connect): tcp connect error: Connection refused (os error 146) file = oximeter/collector/src/agent.rs:595
4942026-03-18T21:14:42.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = ec5534db-bac2-43a3-88a9-e3fb24d88283 producer_ip = fd00:1122:3344:101::1 producer_port = 47848
4952026-03-18T21:14:42.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4962026-03-18T21:14:42.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4972026-03-18T21:14:42.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = ec5534db-bac2-43a3-88a9-e3fb24d88283 producer_ip = fd00:1122:3344:101::1 producer_port = 47848
4982026-03-18T21:14:42.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4992026-03-18T21:14:42.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5002026-03-18T21:14:42.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5012026-03-18T21:14:42.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5022026-03-18T21:14:42.185ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
5032026-03-18T21:14:42.185ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
5042026-03-18T21:14:42.185ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
5052026-03-18T21:14:42.188ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
5062026-03-18T21:14:42.222ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = ec5534db-bac2-43a3-88a9-e3fb24d88283 producer_ip = fd00:1122:3344:101::1 producer_port = 47848
5072026-03-18T21:14:42.225ZDEBGoximeter (results-sink): inserting 1422 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
5082026-03-18T21:14:42.226ZDEBGoximeter (clickhouse-client): unrolling 1422 total samples collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
5092026-03-18T21:14:42.226ZDEBGoximeter (results-sink-cluster): inserting 1422 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
5102026-03-18T21:14:42.283ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 2 table_name = fields_ipaddr
5112026-03-18T21:14:42.285ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 1987 table_name = fields_string
5122026-03-18T21:14:42.287ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 38 table_name = fields_u16
5132026-03-18T21:14:42.288ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 708 table_name = fields_u32
5142026-03-18T21:14:42.290ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 1 table_name = fields_u64
5152026-03-18T21:14:42.291ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 1030 table_name = fields_uuid
5162026-03-18T21:14:42.293ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 1336 table_name = measurements_cumulativeu64
5172026-03-18T21:14:42.295ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 36 table_name = measurements_histogramu64
5182026-03-18T21:14:42.297ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 50 table_name = measurements_u64
5192026-03-18T21:14:42.326ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
5202026-03-18T21:14:43.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5212026-03-18T21:14:43.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5222026-03-18T21:14:43.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5232026-03-18T21:14:43.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5242026-03-18T21:14:43.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5252026-03-18T21:14:43.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5262026-03-18T21:14:44.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5272026-03-18T21:14:44.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5282026-03-18T21:14:44.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5292026-03-18T21:14:44.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5302026-03-18T21:14:44.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5312026-03-18T21:14:44.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5322026-03-18T21:14:45.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5332026-03-18T21:14:45.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5342026-03-18T21:14:45.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5352026-03-18T21:14:45.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5362026-03-18T21:14:45.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5372026-03-18T21:14:45.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5382026-03-18T21:14:46.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5392026-03-18T21:14:46.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5402026-03-18T21:14:46.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5412026-03-18T21:14:46.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5422026-03-18T21:14:46.168ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5432026-03-18T21:14:46.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5442026-03-18T21:14:47.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5452026-03-18T21:14:47.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5462026-03-18T21:14:47.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5472026-03-18T21:14:47.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5482026-03-18T21:14:47.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5492026-03-18T21:14:47.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5502026-03-18T21:14:48.161ZDEBGoximeter (results-sink): inserting 200 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
5512026-03-18T21:14:48.161ZDEBGoximeter (results-sink-cluster): inserting 200 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
5522026-03-18T21:14:48.161ZDEBGoximeter (clickhouse-client): unrolling 200 total samples collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
5532026-03-18T21:14:48.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5542026-03-18T21:14:48.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5552026-03-18T21:14:48.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5562026-03-18T21:14:48.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5572026-03-18T21:14:48.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5582026-03-18T21:14:48.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5592026-03-18T21:14:48.171ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 52 table_name = fields_string
5602026-03-18T21:14:48.172ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 56 table_name = fields_uuid
5612026-03-18T21:14:48.174ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 150 table_name = measurements_cumulativeu64
5622026-03-18T21:14:48.175ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 50 table_name = measurements_u64
5632026-03-18T21:14:48.263ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
5642026-03-18T21:14:49.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5652026-03-18T21:14:49.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5662026-03-18T21:14:49.168ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5672026-03-18T21:14:49.168ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5682026-03-18T21:14:49.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5692026-03-18T21:14:49.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5702026-03-18T21:14:50.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5712026-03-18T21:14:50.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5722026-03-18T21:14:50.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5732026-03-18T21:14:50.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5742026-03-18T21:14:50.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5752026-03-18T21:14:50.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5762026-03-18T21:14:51.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5772026-03-18T21:14:51.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5782026-03-18T21:14:51.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5792026-03-18T21:14:51.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5802026-03-18T21:14:51.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5812026-03-18T21:14:51.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5822026-03-18T21:14:52.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5832026-03-18T21:14:52.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5842026-03-18T21:14:52.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5852026-03-18T21:14:52.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5862026-03-18T21:14:52.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5872026-03-18T21:14:52.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5882026-03-18T21:14:52.185ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
5892026-03-18T21:14:52.185ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
5902026-03-18T21:14:52.189ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 218d8b94-7a22-4306-aad7-d5a24311e301 producer_ip = fd00:1122:3344:101::b producer_port = 36013
5912026-03-18T21:14:53.161ZDEBGoximeter (results-sink): inserting 225 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
5922026-03-18T21:14:53.161ZDEBGoximeter (results-sink-cluster): inserting 225 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
5932026-03-18T21:14:53.161ZDEBGoximeter (clickhouse-client): unrolling 225 total samples collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
5942026-03-18T21:14:53.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5952026-03-18T21:14:53.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5962026-03-18T21:14:53.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5972026-03-18T21:14:53.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5982026-03-18T21:14:53.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5992026-03-18T21:14:53.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6002026-03-18T21:14:53.172ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 102 table_name = fields_string
6012026-03-18T21:14:53.174ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 25 table_name = fields_u16
6022026-03-18T21:14:53.175ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 81 table_name = fields_uuid
6032026-03-18T21:14:53.176ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 150 table_name = measurements_cumulativeu64
6042026-03-18T21:14:53.178ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 25 table_name = measurements_histogramu64
6052026-03-18T21:14:53.180ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 50 table_name = measurements_u64
6062026-03-18T21:14:53.262ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
6072026-03-18T21:14:54.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6082026-03-18T21:14:54.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6092026-03-18T21:14:54.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6102026-03-18T21:14:54.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6112026-03-18T21:14:54.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6122026-03-18T21:14:54.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6132026-03-18T21:14:55.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6142026-03-18T21:14:55.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6152026-03-18T21:14:55.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6162026-03-18T21:14:55.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6172026-03-18T21:14:55.168ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6182026-03-18T21:14:55.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6192026-03-18T21:14:56.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6202026-03-18T21:14:56.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6212026-03-18T21:14:56.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6222026-03-18T21:14:56.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6232026-03-18T21:14:56.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6242026-03-18T21:14:56.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6252026-03-18T21:14:57.153ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
6262026-03-18T21:14:57.153ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?sort_by=id_ascending
6272026-03-18T21:14:57.158ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "8395a808-11af-47f8-bafc-ca1f1a54234c", "content-length": "1274", "date": "Wed, 18 Mar 2026 21:14:57 GMT"} })
6282026-03-18T21:14:57.158ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOTliZDI2Ni1mZjEyLTQ2MTctYmY4Zi04OTNlYWJiMzI1ZWQifX0%3D
6292026-03-18T21:14:57.161ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 813cfaf6-f373-4a92-9eb9-18556a45526d producer_ip = fd00:1122:3344:101::2 producer_port = 53473
6302026-03-18T21:14:57.161ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 813cfaf6-f373-4a92-9eb9-18556a45526d producer_ip = fd00:1122:3344:101::2 producer_port = 53473
6312026-03-18T21:14:57.161ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/ac48f1de-dedf-4f48-a035-c424ed2ee7b0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOTliZDI2Ni1mZjEyLTQ2MTctYmY4Zi04OTNlYWJiMzI1ZWQifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "3967d908-ed3b-4313-b3a5-45928d0e912d", "content-length": "29", "date": "Wed, 18 Mar 2026 21:14:57 GMT"} })
6322026-03-18T21:14:57.161ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:57303 collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 58831be5-b154-4daa-b08e-bc423c0cb7c5
6332026-03-18T21:14:57.161ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:53876 collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = f4a46aaa-97fc-4b23-a891-b41f12e39119
6342026-03-18T21:14:57.161ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = f99bd266-ff12-4617-bf8f-893eabb325ed
6352026-03-18T21:14:57.161ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 8 n_pruned_tasks = 0
6362026-03-18T21:14:57.163ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 58831be5-b154-4daa-b08e-bc423c0cb7c5 producer_ip = fd00:1122:3344:101::c producer_port = 57303
6372026-03-18T21:14:57.163ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = f4a46aaa-97fc-4b23-a891-b41f12e39119 producer_ip = fd00:1122:3344:101::2 producer_port = 53876
6382026-03-18T21:14:57.163ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = f4a46aaa-97fc-4b23-a891-b41f12e39119 producer_ip = fd00:1122:3344:101::2 producer_port = 53876
6392026-03-18T21:14:57.163ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = f4a46aaa-97fc-4b23-a891-b41f12e39119 producer_ip = fd00:1122:3344:101::2 producer_port = 53876
6402026-03-18T21:14:57.163ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = f99bd266-ff12-4617-bf8f-893eabb325ed producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6412026-03-18T21:14:57.163ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 58831be5-b154-4daa-b08e-bc423c0cb7c5 producer_ip = fd00:1122:3344:101::c producer_port = 57303
6422026-03-18T21:14:57.163ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 58831be5-b154-4daa-b08e-bc423c0cb7c5 producer_ip = fd00:1122:3344:101::c producer_port = 57303
6432026-03-18T21:14:57.163ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = f99bd266-ff12-4617-bf8f-893eabb325ed producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6442026-03-18T21:14:57.163ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = f99bd266-ff12-4617-bf8f-893eabb325ed producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6452026-03-18T21:14:57.163ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 813cfaf6-f373-4a92-9eb9-18556a45526d producer_ip = fd00:1122:3344:101::2 producer_port = 53473
6462026-03-18T21:14:57.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6472026-03-18T21:14:57.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6482026-03-18T21:14:57.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6492026-03-18T21:14:57.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6502026-03-18T21:14:57.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6512026-03-18T21:14:57.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6522026-03-18T21:14:57.172ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 58831be5-b154-4daa-b08e-bc423c0cb7c5 producer_ip = fd00:1122:3344:101::c producer_port = 57303
6532026-03-18T21:14:57.173ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = f4a46aaa-97fc-4b23-a891-b41f12e39119 producer_ip = fd00:1122:3344:101::2 producer_port = 53876
6542026-03-18T21:14:57.174ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f99bd266-ff12-4617-bf8f-893eabb325ed producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6552026-03-18T21:14:58.161ZDEBGoximeter (results-sink): inserting 265 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
6562026-03-18T21:14:58.161ZDEBGoximeter (results-sink-cluster): inserting 265 samples into database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d
6572026-03-18T21:14:58.161ZDEBGoximeter (clickhouse-client): unrolling 265 total samples collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
6582026-03-18T21:14:58.162ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = f99bd266-ff12-4617-bf8f-893eabb325ed producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6592026-03-18T21:14:58.162ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = f99bd266-ff12-4617-bf8f-893eabb325ed producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6602026-03-18T21:14:58.163ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f99bd266-ff12-4617-bf8f-893eabb325ed producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6612026-03-18T21:14:58.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6622026-03-18T21:14:58.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6632026-03-18T21:14:58.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6642026-03-18T21:14:58.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6652026-03-18T21:14:58.168ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6662026-03-18T21:14:58.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6672026-03-18T21:14:58.171ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
6682026-03-18T21:14:58.174ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:58.171323727Z } timeseries_name = static_routing_config:static_routes
6692026-03-18T21:14:58.174ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
6702026-03-18T21:14:58.176ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:58.174607334Z } timeseries_name = static_routing_config:static_nexthops
6712026-03-18T21:14:58.176ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
6722026-03-18T21:14:58.179ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:58.176843246Z } timeseries_name = switch_rib:active_routes
6732026-03-18T21:14:58.179ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
6742026-03-18T21:14:58.181ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T21:14:58.179056447Z } timeseries_name = mg_lower:routes_blocked_by_link_state
6752026-03-18T21:14:58.181ZDEBGoximeter (clickhouse-client): inserting 4 new timeseries schema collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd
6762026-03-18T21:14:58.184ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 24 table_name = fields_i16
6772026-03-18T21:14:58.185ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 6 table_name = fields_ipaddr
6782026-03-18T21:14:58.186ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 205 table_name = fields_string
6792026-03-18T21:14:58.188ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 31 table_name = fields_u16
6802026-03-18T21:14:58.189ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 24 table_name = fields_u32
6812026-03-18T21:14:58.190ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 12 table_name = fields_u8
6822026-03-18T21:14:58.192ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 128 table_name = fields_uuid
6832026-03-18T21:14:58.193ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 191 table_name = measurements_cumulativeu64
6842026-03-18T21:14:58.195ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 13 table_name = measurements_histogramu64
6852026-03-18T21:14:58.196ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 9 table_name = measurements_i64
6862026-03-18T21:14:58.198ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d id = 501ab625-5e61-4733-a6dc-35b48e9d14cd n_rows = 52 table_name = measurements_u64
6872026-03-18T21:14:58.262ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
6882026-03-18T21:14:59.162ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = f99bd266-ff12-4617-bf8f-893eabb325ed producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6892026-03-18T21:14:59.162ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = f99bd266-ff12-4617-bf8f-893eabb325ed producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6902026-03-18T21:14:59.163ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f99bd266-ff12-4617-bf8f-893eabb325ed producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6912026-03-18T21:14:59.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6922026-03-18T21:14:59.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6932026-03-18T21:14:59.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6942026-03-18T21:14:59.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6952026-03-18T21:14:59.168ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6962026-03-18T21:14:59.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6972026-03-18T21:15:00.162ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = f99bd266-ff12-4617-bf8f-893eabb325ed producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6982026-03-18T21:15:00.162ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = f99bd266-ff12-4617-bf8f-893eabb325ed producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6992026-03-18T21:15:00.163ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f99bd266-ff12-4617-bf8f-893eabb325ed producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7002026-03-18T21:15:00.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7012026-03-18T21:15:00.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7022026-03-18T21:15:00.167ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7032026-03-18T21:15:00.167ZDEBGoximeter (collection-task): collecting from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7042026-03-18T21:15:00.169ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = da728ab7-4b8d-45ac-b31d-05cd2cbed6a3 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7052026-03-18T21:15:00.170ZDEBGoximeter (collection-task): collected results from producer collector_id = ac48f1de-dedf-4f48-a035-c424ed2ee7b0 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5980c523-553d-40c4-bc51-0d297eeda090 producer_ip = fd00:1122:3344:101::1 producer_port = 8001