Max level shown:
1 [ Jan 23 16:58:35 Enabled. ]
2 [ Jan 23 16:58:35 Rereading configuration. ]
3 [ Jan 23 16:58:36 Rereading configuration. ]
4 [ Jan 23 16:58:39 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id c6603d05-c0f8-4821-9ab1-f70212d2f47d &"). ]
5 [ Jan 23 16:58:39 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-01-23T16:58:39.535ZDEBGoximeter: registered DTrace probes
82026-01-23T16:58:39.541ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:264
92026-01-23T16:58:39.543ZDEBGoximeter: creating ClickHouse client
102026-01-23T16:58:39.575ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
112026-01-23T16:58:45.961ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:900 id = aa39de1e-a933-4c61-b341-19e340756d76
122026-01-23T16:58:45.961ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
132026-01-23T16:58:45.961ZINFOoximeter (clickhouse-client): reading db version collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:800 id = aa39de1e-a933-4c61-b341-19e340756d76
142026-01-23T16:58:45.962ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:900 id = aa39de1e-a933-4c61-b341-19e340756d76
152026-01-23T16:58:45.962ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:805 id = aa39de1e-a933-4c61-b341-19e340756d76 version = 0
162026-01-23T16:58:45.962ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:810 id = aa39de1e-a933-4c61-b341-19e340756d76
172026-01-23T16:58:45.962ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
182026-01-23T16:58:46.122ZINFOoximeter (clickhouse-client): inserting current version collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:831 id = aa39de1e-a933-4c61-b341-19e340756d76 version = 14
192026-01-23T16:58:46.154ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = cf259aa7-28c9-4938-b806-e40f65de91f3
202026-01-23T16:58:46.164ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-01-23T16:58:46.164ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-01-23T16:58:46.164ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-01-23T16:58:46.164ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-01-23T16:58:46.164ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.6/src/server.rs:328 local_addr = [fd00:1122:3344:101::d]:12223
252026-01-23T16:58:46.176ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-01-23T16:58:46.176ZDEBGoximeter: registered USDT probes
272026-01-23T16:58:46.176ZDEBGoximeter: contacting nexus
282026-01-23T16:58:46.285ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
292026-01-23T16:58:46.292ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
302026-01-23T16:58:46.292ZWARNoximeter: failed to contact nexus, will retry in 357.173479ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:409
312026-01-23T16:58:46.650ZDEBGoximeter: contacting nexus
322026-01-23T16:58:46.650ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
332026-01-23T16:58:46.650ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
342026-01-23T16:58:46.650ZWARNoximeter: failed to contact nexus, will retry in 389.770181ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:409
352026-01-23T16:58:47.041ZDEBGoximeter: contacting nexus
362026-01-23T16:58:47.041ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
372026-01-23T16:58:47.041ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
382026-01-23T16:58:47.041ZWARNoximeter: failed to contact nexus, will retry in 1.287406084s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:409
392026-01-23T16:58:48.329ZDEBGoximeter: contacting nexus
402026-01-23T16:58:48.329ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
412026-01-23T16:58:48.329ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
422026-01-23T16:58:48.329ZWARNoximeter: failed to contact nexus, will retry in 2.08393972s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:409
432026-01-23T16:58:50.414ZDEBGoximeter: contacting nexus
442026-01-23T16:58:50.414ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
452026-01-23T16:58:50.474ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "94481ba9-f394-4839-b072-2c6aef4f5bde", "date": "Fri, 23 Jan 2026 16:58:50 GMT"} })
462026-01-23T16:58:50.474ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:427 id = c6603d05-c0f8-4821-9ab1-f70212d2f47d
472026-01-23T16:58:50.474ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:554
482026-01-23T16:58:50.475ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
492026-01-23T16:58:50.480ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/c6603d05-c0f8-4821-9ab1-f70212d2f47d/producers?sort_by=id_ascending
502026-01-23T16:58:50.564ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/c6603d05-c0f8-4821-9ab1-f70212d2f47d/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea4b1196-98b0-43b8-ac05-69cb3d0dcf8d", "content-length": "29", "date": "Fri, 23 Jan 2026 16:58:50 GMT"} })
512026-01-23T16:58:50.564ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 0 n_pruned_tasks = 0
522026-01-23T16:59:05.475ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
532026-01-23T16:59:05.475ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/c6603d05-c0f8-4821-9ab1-f70212d2f47d/producers?sort_by=id_ascending
542026-01-23T16:59:05.481ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/c6603d05-c0f8-4821-9ab1-f70212d2f47d/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9caff80-2f73-48a3-b13c-c77c75c01bb8", "content-length": "436", "date": "Fri, 23 Jan 2026 16:59:05 GMT"} })
552026-01-23T16:59:05.485ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/c6603d05-c0f8-4821-9ab1-f70212d2f47d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOTA3NjY5OC0yNWEyLTQwNDItYTFhOS1jZWZmN2IxOGRkYmUifX0%3D
562026-01-23T16:59:05.495ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/c6603d05-c0f8-4821-9ab1-f70212d2f47d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOTA3NjY5OC0yNWEyLTQwNDItYTFhOS1jZWZmN2IxOGRkYmUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "4380cf04-e7ab-443b-93b0-f8c79b5df742", "content-length": "29", "date": "Fri, 23 Jan 2026 16:59:05 GMT"} })
572026-01-23T16:59:05.497ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:60482 collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 0bdd34df-512d-451e-8f1b-918a39ad7eed
582026-01-23T16:59:05.497ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe
592026-01-23T16:59:05.497ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 2 n_pruned_tasks = 0
602026-01-23T16:59:05.498ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
612026-01-23T16:59:05.498ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 0bdd34df-512d-451e-8f1b-918a39ad7eed producer_ip = fd00:1122:3344:101::a producer_port = 60482
622026-01-23T16:59:05.533ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 0bdd34df-512d-451e-8f1b-918a39ad7eed producer_ip = fd00:1122:3344:101::a producer_port = 60482
632026-01-23T16:59:05.533ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
642026-01-23T16:59:05.581ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
652026-01-23T16:59:05.581ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 0bdd34df-512d-451e-8f1b-918a39ad7eed producer_ip = fd00:1122:3344:101::a producer_port = 60482
662026-01-23T16:59:05.592ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 0bdd34df-512d-451e-8f1b-918a39ad7eed producer_ip = fd00:1122:3344:101::a producer_port = 60482
672026-01-23T16:59:05.594ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
682026-01-23T16:59:06.155ZDEBGoximeter (results-sink): inserting 17 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
692026-01-23T16:59:06.155ZDEBGoximeter (results-sink-cluster): inserting 17 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
702026-01-23T16:59:06.155ZDEBGoximeter (clickhouse-client): unrolling 17 total samples collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
712026-01-23T16:59:06.156ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
722026-01-23T16:59:06.160ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:06.156005645Z } timeseries_name = oximeter_collector:collections
732026-01-23T16:59:06.171ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
742026-01-23T16:59:06.182ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:06.171107336Z } timeseries_name = http_service:request_latency_histogram
752026-01-23T16:59:06.182ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
762026-01-23T16:59:06.185ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:06.182780311Z } timeseries_name = collection_target:cpus_provisioned
772026-01-23T16:59:06.185ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
782026-01-23T16:59:06.186ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:06.185727373Z } timeseries_name = collection_target:ram_provisioned
792026-01-23T16:59:06.186ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
802026-01-23T16:59:06.187ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:06.186646792Z } timeseries_name = collection_target:virtual_disk_space_provisioned
812026-01-23T16:59:06.187ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
822026-01-23T16:59:06.188ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:06.187903676Z } timeseries_name = static_routing_config:static_routes
832026-01-23T16:59:06.188ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
842026-01-23T16:59:06.189ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:06.188882456Z } timeseries_name = static_routing_config:static_nexthops
852026-01-23T16:59:06.189ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
862026-01-23T16:59:06.190ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:06.189813266Z } timeseries_name = switch_rib:active_routes
872026-01-23T16:59:06.190ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
882026-01-23T16:59:06.191ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:06.190819437Z } timeseries_name = mg_lower:routes_blocked_by_link_state
892026-01-23T16:59:06.191ZDEBGoximeter (clickhouse-client): inserting 9 new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
902026-01-23T16:59:06.202ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 4 table_name = fields_ipaddr
912026-01-23T16:59:06.204ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 10 table_name = fields_string
922026-01-23T16:59:06.206ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 6 table_name = fields_u16
932026-01-23T16:59:06.208ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 23 table_name = fields_uuid
942026-01-23T16:59:06.214ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 4 table_name = measurements_cumulativeu64
952026-01-23T16:59:06.216ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 2 table_name = measurements_histogramu64
962026-01-23T16:59:06.218ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 9 table_name = measurements_i64
972026-01-23T16:59:06.220ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 2 table_name = measurements_u64
982026-01-23T16:59:06.256ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
992026-01-23T16:59:06.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1002026-01-23T16:59:06.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1012026-01-23T16:59:06.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1022026-01-23T16:59:07.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1032026-01-23T16:59:07.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1042026-01-23T16:59:07.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1052026-01-23T16:59:08.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1062026-01-23T16:59:08.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1072026-01-23T16:59:08.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1082026-01-23T16:59:09.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1092026-01-23T16:59:09.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1102026-01-23T16:59:09.500ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1112026-01-23T16:59:10.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1122026-01-23T16:59:10.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1132026-01-23T16:59:10.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1142026-01-23T16:59:11.155ZDEBGoximeter (results-sink): inserting 20 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
1152026-01-23T16:59:11.155ZDEBGoximeter (results-sink-cluster): inserting 20 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
1162026-01-23T16:59:11.155ZDEBGoximeter (clickhouse-client): unrolling 20 total samples collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
1172026-01-23T16:59:11.160ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 4 table_name = fields_string
1182026-01-23T16:59:11.162ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 8 table_name = fields_uuid
1192026-01-23T16:59:11.167ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 10 table_name = measurements_cumulativeu64
1202026-01-23T16:59:11.168ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 10 table_name = measurements_u64
1212026-01-23T16:59:11.257ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
1222026-01-23T16:59:11.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1232026-01-23T16:59:11.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1242026-01-23T16:59:11.500ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1252026-01-23T16:59:12.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1262026-01-23T16:59:12.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1272026-01-23T16:59:12.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1282026-01-23T16:59:13.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1292026-01-23T16:59:13.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1302026-01-23T16:59:13.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1312026-01-23T16:59:14.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1322026-01-23T16:59:14.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1332026-01-23T16:59:14.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1342026-01-23T16:59:15.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 0bdd34df-512d-451e-8f1b-918a39ad7eed producer_ip = fd00:1122:3344:101::a producer_port = 60482
1352026-01-23T16:59:15.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 0bdd34df-512d-451e-8f1b-918a39ad7eed producer_ip = fd00:1122:3344:101::a producer_port = 60482
1362026-01-23T16:59:15.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1372026-01-23T16:59:15.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1382026-01-23T16:59:15.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1392026-01-23T16:59:15.502ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 0bdd34df-512d-451e-8f1b-918a39ad7eed producer_ip = fd00:1122:3344:101::a producer_port = 60482
1402026-01-23T16:59:16.155ZDEBGoximeter (results-sink): inserting 45 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
1412026-01-23T16:59:16.155ZDEBGoximeter (results-sink-cluster): inserting 45 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
1422026-01-23T16:59:16.155ZDEBGoximeter (clickhouse-client): unrolling 45 total samples collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
1432026-01-23T16:59:16.162ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 36 table_name = fields_string
1442026-01-23T16:59:16.164ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 16 table_name = fields_u16
1452026-01-23T16:59:16.166ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 29 table_name = fields_uuid
1462026-01-23T16:59:16.168ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 10 table_name = measurements_cumulativeu64
1472026-01-23T16:59:16.174ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 16 table_name = measurements_histogramu64
1482026-01-23T16:59:16.176ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 9 table_name = measurements_i64
1492026-01-23T16:59:16.177ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 10 table_name = measurements_u64
1502026-01-23T16:59:16.257ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
1512026-01-23T16:59:16.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1522026-01-23T16:59:16.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1532026-01-23T16:59:16.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1542026-01-23T16:59:17.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1552026-01-23T16:59:17.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1562026-01-23T16:59:17.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1572026-01-23T16:59:18.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1582026-01-23T16:59:18.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1592026-01-23T16:59:18.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1602026-01-23T16:59:19.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1612026-01-23T16:59:19.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1622026-01-23T16:59:19.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1632026-01-23T16:59:20.475ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
1642026-01-23T16:59:20.475ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/c6603d05-c0f8-4821-9ab1-f70212d2f47d/producers?sort_by=id_ascending
1652026-01-23T16:59:20.487ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/c6603d05-c0f8-4821-9ab1-f70212d2f47d/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ed5bf6a-d0d3-4ba9-a4a1-f66199525443", "content-length": "721", "date": "Fri, 23 Jan 2026 16:59:20 GMT"} })
1662026-01-23T16:59:20.487ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/c6603d05-c0f8-4821-9ab1-f70212d2f47d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOTA3NjY5OC0yNWEyLTQwNDItYTFhOS1jZWZmN2IxOGRkYmUifX0%3D
1672026-01-23T16:59:20.492ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/c6603d05-c0f8-4821-9ab1-f70212d2f47d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOTA3NjY5OC0yNWEyLTQwNDItYTFhOS1jZWZmN2IxOGRkYmUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "53e5243c-42ca-4861-89fe-4e34fc2fed5b", "content-length": "29", "date": "Fri, 23 Jan 2026 16:59:20 GMT"} })
1682026-01-23T16:59:20.492ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52
1692026-01-23T16:59:20.492ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:47044 collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = cec3cf60-20e6-4909-8860-0c588996b211
1702026-01-23T16:59:20.492ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 4 n_pruned_tasks = 0
1712026-01-23T16:59:20.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1722026-01-23T16:59:20.493ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1732026-01-23T16:59:20.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = cec3cf60-20e6-4909-8860-0c588996b211 producer_ip = fd00:1122:3344:101::2 producer_port = 47044
1742026-01-23T16:59:20.493ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = cec3cf60-20e6-4909-8860-0c588996b211 producer_ip = fd00:1122:3344:101::2 producer_port = 47044
1752026-01-23T16:59:20.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1762026-01-23T16:59:20.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1772026-01-23T16:59:20.500ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1782026-01-23T16:59:20.564ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = cec3cf60-20e6-4909-8860-0c588996b211 producer_ip = fd00:1122:3344:101::2 producer_port = 47044
1792026-01-23T16:59:20.569ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1802026-01-23T16:59:20.578ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = cec3cf60-20e6-4909-8860-0c588996b211 producer_ip = fd00:1122:3344:101::2 producer_port = 47044
1812026-01-23T16:59:20.579ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1822026-01-23T16:59:21.156ZDEBGoximeter (results-sink): inserting 58 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
1832026-01-23T16:59:21.156ZDEBGoximeter (results-sink-cluster): inserting 58 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
1842026-01-23T16:59:21.156ZDEBGoximeter (clickhouse-client): unrolling 58 total samples collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
1852026-01-23T16:59:21.158ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
1862026-01-23T16:59:21.206ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:21.158425959Z } timeseries_name = ddm_router:originated_underlay_prefixes
1872026-01-23T16:59:21.206ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
1882026-01-23T16:59:21.208ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:21.206586864Z } timeseries_name = ddm_router:originated_tunnel_endpoints
1892026-01-23T16:59:21.208ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
1902026-01-23T16:59:21.210ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:21.208849279Z } timeseries_name = ddm_session:solicitations_sent
1912026-01-23T16:59:21.210ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
1922026-01-23T16:59:21.212ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:21.210679998Z } timeseries_name = ddm_session:solicitations_received
1932026-01-23T16:59:21.212ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
1942026-01-23T16:59:21.214ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:21.212444327Z } timeseries_name = ddm_session:advertisements_sent
1952026-01-23T16:59:21.214ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
1962026-01-23T16:59:21.215ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:21.214049194Z } timeseries_name = ddm_session:advertisements_received
1972026-01-23T16:59:21.215ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
1982026-01-23T16:59:21.217ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:21.215686222Z } timeseries_name = ddm_session:peer_expirations
1992026-01-23T16:59:21.217ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
2002026-01-23T16:59:21.218ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:21.217374670Z } timeseries_name = ddm_session:peer_address_changes
2012026-01-23T16:59:21.219ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
2022026-01-23T16:59:21.220ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:21.219007807Z } timeseries_name = ddm_session:peer_sessions_established
2032026-01-23T16:59:21.220ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
2042026-01-23T16:59:21.222ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:21.220582774Z } timeseries_name = ddm_session:updates_sent
2052026-01-23T16:59:21.222ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
2062026-01-23T16:59:21.225ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:21.222909479Z } timeseries_name = ddm_session:updates_received
2072026-01-23T16:59:21.225ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
2082026-01-23T16:59:21.227ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:21.225278004Z } timeseries_name = ddm_session:update_send_fail
2092026-01-23T16:59:21.227ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
2102026-01-23T16:59:21.228ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:21.227248215Z } timeseries_name = ddm_session:imported_underlay_prefixes
2112026-01-23T16:59:21.229ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
2122026-01-23T16:59:21.230ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:21.229018484Z } timeseries_name = ddm_session:imported_tunnel_endpoints
2132026-01-23T16:59:21.231ZDEBGoximeter (clickhouse-client): inserting 14 new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
2142026-01-23T16:59:21.236ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 4 table_name = fields_ipaddr
2152026-01-23T16:59:21.240ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 52 table_name = fields_string
2162026-01-23T16:59:21.243ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 14 table_name = fields_u16
2172026-01-23T16:59:21.246ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 50 table_name = fields_uuid
2182026-01-23T16:59:21.249ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 32 table_name = measurements_cumulativeu64
2192026-01-23T16:59:21.257ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
2202026-01-23T16:59:21.257ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 10 table_name = measurements_histogramu64
2212026-01-23T16:59:21.260ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 16 table_name = measurements_u64
2222026-01-23T16:59:21.494ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2232026-01-23T16:59:21.494ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2242026-01-23T16:59:21.497ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2252026-01-23T16:59:21.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2262026-01-23T16:59:21.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2272026-01-23T16:59:21.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2282026-01-23T16:59:22.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2292026-01-23T16:59:22.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2302026-01-23T16:59:22.495ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2312026-01-23T16:59:22.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2322026-01-23T16:59:22.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2332026-01-23T16:59:22.500ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2342026-01-23T16:59:23.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2352026-01-23T16:59:23.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2362026-01-23T16:59:23.495ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2372026-01-23T16:59:23.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2382026-01-23T16:59:23.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2392026-01-23T16:59:23.500ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2402026-01-23T16:59:24.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2412026-01-23T16:59:24.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2422026-01-23T16:59:24.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2432026-01-23T16:59:24.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2442026-01-23T16:59:24.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2452026-01-23T16:59:24.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2462026-01-23T16:59:25.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2472026-01-23T16:59:25.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2482026-01-23T16:59:25.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2492026-01-23T16:59:25.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 0bdd34df-512d-451e-8f1b-918a39ad7eed producer_ip = fd00:1122:3344:101::a producer_port = 60482
2502026-01-23T16:59:25.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 0bdd34df-512d-451e-8f1b-918a39ad7eed producer_ip = fd00:1122:3344:101::a producer_port = 60482
2512026-01-23T16:59:25.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2522026-01-23T16:59:25.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2532026-01-23T16:59:25.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2542026-01-23T16:59:25.502ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 0bdd34df-512d-451e-8f1b-918a39ad7eed producer_ip = fd00:1122:3344:101::a producer_port = 60482
2552026-01-23T16:59:26.155ZDEBGoximeter (results-sink-cluster): inserting 178 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
2562026-01-23T16:59:26.155ZDEBGoximeter (results-sink): inserting 178 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
2572026-01-23T16:59:26.155ZDEBGoximeter (clickhouse-client): unrolling 178 total samples collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
2582026-01-23T16:59:26.165ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 74 table_name = fields_string
2592026-01-23T16:59:26.167ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 22 table_name = fields_u16
2602026-01-23T16:59:26.169ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 63 table_name = fields_uuid
2612026-01-23T16:59:26.171ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 110 table_name = measurements_cumulativeu64
2622026-01-23T16:59:26.173ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 22 table_name = measurements_histogramu64
2632026-01-23T16:59:26.175ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 6 table_name = measurements_i64
2642026-01-23T16:59:26.178ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 40 table_name = measurements_u64
2652026-01-23T16:59:26.256ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
2662026-01-23T16:59:26.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2672026-01-23T16:59:26.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2682026-01-23T16:59:26.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2692026-01-23T16:59:26.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2702026-01-23T16:59:26.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2712026-01-23T16:59:26.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2722026-01-23T16:59:27.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2732026-01-23T16:59:27.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2742026-01-23T16:59:27.495ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2752026-01-23T16:59:27.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2762026-01-23T16:59:27.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2772026-01-23T16:59:27.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2782026-01-23T16:59:28.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2792026-01-23T16:59:28.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2802026-01-23T16:59:28.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2812026-01-23T16:59:28.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2822026-01-23T16:59:28.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2832026-01-23T16:59:28.500ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2842026-01-23T16:59:29.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2852026-01-23T16:59:29.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2862026-01-23T16:59:29.495ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2872026-01-23T16:59:29.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2882026-01-23T16:59:29.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2892026-01-23T16:59:29.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2902026-01-23T16:59:30.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = cec3cf60-20e6-4909-8860-0c588996b211 producer_ip = fd00:1122:3344:101::2 producer_port = 47044
2912026-01-23T16:59:30.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = cec3cf60-20e6-4909-8860-0c588996b211 producer_ip = fd00:1122:3344:101::2 producer_port = 47044
2922026-01-23T16:59:30.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2932026-01-23T16:59:30.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2942026-01-23T16:59:30.495ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = cec3cf60-20e6-4909-8860-0c588996b211 producer_ip = fd00:1122:3344:101::2 producer_port = 47044
2952026-01-23T16:59:30.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2962026-01-23T16:59:30.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2972026-01-23T16:59:30.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2982026-01-23T16:59:30.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2992026-01-23T16:59:31.155ZDEBGoximeter (results-sink): inserting 160 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
3002026-01-23T16:59:31.155ZDEBGoximeter (results-sink-cluster): inserting 160 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
3012026-01-23T16:59:31.155ZDEBGoximeter (clickhouse-client): unrolling 160 total samples collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
3022026-01-23T16:59:31.164ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 50 table_name = fields_string
3032026-01-23T16:59:31.166ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 10 table_name = fields_u16
3042026-01-23T16:59:31.168ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 46 table_name = fields_uuid
3052026-01-23T16:59:31.170ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 110 table_name = measurements_cumulativeu64
3062026-01-23T16:59:31.173ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 10 table_name = measurements_histogramu64
3072026-01-23T16:59:31.175ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 40 table_name = measurements_u64
3082026-01-23T16:59:31.257ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
3092026-01-23T16:59:31.494ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3102026-01-23T16:59:31.494ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3112026-01-23T16:59:31.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3122026-01-23T16:59:31.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3132026-01-23T16:59:31.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3142026-01-23T16:59:31.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3152026-01-23T16:59:32.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3162026-01-23T16:59:32.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3172026-01-23T16:59:32.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3182026-01-23T16:59:32.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3192026-01-23T16:59:32.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3202026-01-23T16:59:32.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3212026-01-23T16:59:33.494ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3222026-01-23T16:59:33.494ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3232026-01-23T16:59:33.497ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3242026-01-23T16:59:33.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3252026-01-23T16:59:33.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3262026-01-23T16:59:33.500ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3272026-01-23T16:59:34.494ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3282026-01-23T16:59:34.494ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3292026-01-23T16:59:34.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3302026-01-23T16:59:34.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3312026-01-23T16:59:34.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3322026-01-23T16:59:34.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3332026-01-23T16:59:35.475ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
3342026-01-23T16:59:35.475ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/c6603d05-c0f8-4821-9ab1-f70212d2f47d/producers?sort_by=id_ascending
3352026-01-23T16:59:35.483ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/c6603d05-c0f8-4821-9ab1-f70212d2f47d/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "98852b03-3833-41b1-8ce6-eaef68840a8f", "content-length": "859", "date": "Fri, 23 Jan 2026 16:59:35 GMT"} })
3362026-01-23T16:59:35.483ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/c6603d05-c0f8-4821-9ab1-f70212d2f47d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOTA3NjY5OC0yNWEyLTQwNDItYTFhOS1jZWZmN2IxOGRkYmUifX0%3D
3372026-01-23T16:59:35.485ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/c6603d05-c0f8-4821-9ab1-f70212d2f47d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOTA3NjY5OC0yNWEyLTQwNDItYTFhOS1jZWZmN2IxOGRkYmUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1113309-d4aa-4c3c-8813-7ce3b8243a0b", "content-length": "29", "date": "Fri, 23 Jan 2026 16:59:35 GMT"} })
3382026-01-23T16:59:35.485ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:53785 collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 25db0992-5e54-413e-a535-ad4dd6a2c493
3392026-01-23T16:59:35.485ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 5 n_pruned_tasks = 0
3402026-01-23T16:59:35.486ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 25db0992-5e54-413e-a535-ad4dd6a2c493 producer_ip = fd00:1122:3344:101::2 producer_port = 53785
3412026-01-23T16:59:35.486ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 25db0992-5e54-413e-a535-ad4dd6a2c493 producer_ip = fd00:1122:3344:101::2 producer_port = 53785
3422026-01-23T16:59:35.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3432026-01-23T16:59:35.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3442026-01-23T16:59:35.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3452026-01-23T16:59:35.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 0bdd34df-512d-451e-8f1b-918a39ad7eed producer_ip = fd00:1122:3344:101::a producer_port = 60482
3462026-01-23T16:59:35.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 0bdd34df-512d-451e-8f1b-918a39ad7eed producer_ip = fd00:1122:3344:101::a producer_port = 60482
3472026-01-23T16:59:35.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3482026-01-23T16:59:35.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3492026-01-23T16:59:35.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3502026-01-23T16:59:35.502ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 0bdd34df-512d-451e-8f1b-918a39ad7eed producer_ip = fd00:1122:3344:101::a producer_port = 60482
3512026-01-23T16:59:35.517ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 25db0992-5e54-413e-a535-ad4dd6a2c493 producer_ip = fd00:1122:3344:101::2 producer_port = 53785
3522026-01-23T16:59:35.546ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 25db0992-5e54-413e-a535-ad4dd6a2c493 producer_ip = fd00:1122:3344:101::2 producer_port = 53785
3532026-01-23T16:59:36.156ZDEBGoximeter (results-sink): inserting 425 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
3542026-01-23T16:59:36.156ZDEBGoximeter (results-sink-cluster): inserting 425 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
3552026-01-23T16:59:36.156ZDEBGoximeter (clickhouse-client): unrolling 425 total samples collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
3562026-01-23T16:59:36.162ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
3572026-01-23T16:59:36.167ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:36.162598943Z } timeseries_name = switch_port_control_data_link:errors_received
3582026-01-23T16:59:36.167ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
3592026-01-23T16:59:36.169ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:36.167792048Z } timeseries_name = switch_port_control_data_link:errors_sent
3602026-01-23T16:59:36.169ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
3612026-01-23T16:59:36.171ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:36.169910251Z } timeseries_name = switch_port_control_data_link:bytes_received
3622026-01-23T16:59:36.171ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
3632026-01-23T16:59:36.173ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:36.171836731Z } timeseries_name = switch_port_control_data_link:packets_received
3642026-01-23T16:59:36.173ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
3652026-01-23T16:59:36.175ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:36.173808543Z } timeseries_name = switch_port_control_data_link:bytes_sent
3662026-01-23T16:59:36.175ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
3672026-01-23T16:59:36.177ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-23T16:59:36.175697423Z } timeseries_name = switch_port_control_data_link:packets_sent
3682026-01-23T16:59:36.187ZDEBGoximeter (clickhouse-client): inserting 6 new timeseries schema collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
3692026-01-23T16:59:36.193ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 24 table_name = fields_i16
3702026-01-23T16:59:36.195ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 2 table_name = fields_ipaddr
3712026-01-23T16:59:36.197ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 195 table_name = fields_string
3722026-01-23T16:59:36.199ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 36 table_name = fields_u16
3732026-01-23T16:59:36.201ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 24 table_name = fields_u32
3742026-01-23T16:59:36.203ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 12 table_name = fields_u8
3752026-01-23T16:59:36.205ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 96 table_name = fields_uuid
3762026-01-23T16:59:36.207ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 363 table_name = measurements_cumulativeu64
3772026-01-23T16:59:36.209ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 22 table_name = measurements_histogramu64
3782026-01-23T16:59:36.211ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 40 table_name = measurements_u64
3792026-01-23T16:59:36.256ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
3802026-01-23T16:59:36.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3812026-01-23T16:59:36.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3822026-01-23T16:59:36.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3832026-01-23T16:59:36.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3842026-01-23T16:59:36.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3852026-01-23T16:59:36.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3862026-01-23T16:59:37.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3872026-01-23T16:59:37.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3882026-01-23T16:59:37.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3892026-01-23T16:59:37.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3902026-01-23T16:59:37.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3912026-01-23T16:59:37.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3922026-01-23T16:59:38.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3932026-01-23T16:59:38.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3942026-01-23T16:59:38.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3952026-01-23T16:59:38.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3962026-01-23T16:59:38.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3972026-01-23T16:59:38.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3982026-01-23T16:59:39.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3992026-01-23T16:59:39.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4002026-01-23T16:59:39.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4012026-01-23T16:59:39.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4022026-01-23T16:59:39.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4032026-01-23T16:59:39.500ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4042026-01-23T16:59:40.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = cec3cf60-20e6-4909-8860-0c588996b211 producer_ip = fd00:1122:3344:101::2 producer_port = 47044
4052026-01-23T16:59:40.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = cec3cf60-20e6-4909-8860-0c588996b211 producer_ip = fd00:1122:3344:101::2 producer_port = 47044
4062026-01-23T16:59:40.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4072026-01-23T16:59:40.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4082026-01-23T16:59:40.495ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = cec3cf60-20e6-4909-8860-0c588996b211 producer_ip = fd00:1122:3344:101::2 producer_port = 47044
4092026-01-23T16:59:40.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4102026-01-23T16:59:40.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4112026-01-23T16:59:40.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4122026-01-23T16:59:40.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4132026-01-23T16:59:41.156ZDEBGoximeter (results-sink): inserting 160 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
4142026-01-23T16:59:41.156ZDEBGoximeter (results-sink-cluster): inserting 160 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
4152026-01-23T16:59:41.156ZDEBGoximeter (clickhouse-client): unrolling 160 total samples collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
4162026-01-23T16:59:41.164ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 50 table_name = fields_string
4172026-01-23T16:59:41.166ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 10 table_name = fields_u16
4182026-01-23T16:59:41.168ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 46 table_name = fields_uuid
4192026-01-23T16:59:41.169ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 110 table_name = measurements_cumulativeu64
4202026-01-23T16:59:41.172ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 10 table_name = measurements_histogramu64
4212026-01-23T16:59:41.173ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 40 table_name = measurements_u64
4222026-01-23T16:59:41.256ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
4232026-01-23T16:59:41.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4242026-01-23T16:59:41.494ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4252026-01-23T16:59:41.497ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4262026-01-23T16:59:41.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4272026-01-23T16:59:41.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4282026-01-23T16:59:41.500ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4292026-01-23T16:59:42.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4302026-01-23T16:59:42.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4312026-01-23T16:59:42.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4322026-01-23T16:59:42.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4332026-01-23T16:59:42.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4342026-01-23T16:59:42.500ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4352026-01-23T16:59:43.494ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4362026-01-23T16:59:43.494ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4372026-01-23T16:59:43.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4382026-01-23T16:59:43.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4392026-01-23T16:59:43.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4402026-01-23T16:59:43.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4412026-01-23T16:59:44.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4422026-01-23T16:59:44.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4432026-01-23T16:59:44.495ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4442026-01-23T16:59:44.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4452026-01-23T16:59:44.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4462026-01-23T16:59:44.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4472026-01-23T16:59:45.494ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4482026-01-23T16:59:45.494ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4492026-01-23T16:59:45.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4502026-01-23T16:59:45.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 0bdd34df-512d-451e-8f1b-918a39ad7eed producer_ip = fd00:1122:3344:101::a producer_port = 60482
4512026-01-23T16:59:45.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4522026-01-23T16:59:45.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 0bdd34df-512d-451e-8f1b-918a39ad7eed producer_ip = fd00:1122:3344:101::a producer_port = 60482
4532026-01-23T16:59:45.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4542026-01-23T16:59:45.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4552026-01-23T16:59:45.501ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 0bdd34df-512d-451e-8f1b-918a39ad7eed producer_ip = fd00:1122:3344:101::a producer_port = 60482
4562026-01-23T16:59:46.156ZDEBGoximeter (results-sink-cluster): inserting 172 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
4572026-01-23T16:59:46.156ZDEBGoximeter (results-sink): inserting 172 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
4582026-01-23T16:59:46.156ZDEBGoximeter (clickhouse-client): unrolling 172 total samples collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
4592026-01-23T16:59:46.165ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 74 table_name = fields_string
4602026-01-23T16:59:46.167ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 22 table_name = fields_u16
4612026-01-23T16:59:46.169ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 58 table_name = fields_uuid
4622026-01-23T16:59:46.170ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 110 table_name = measurements_cumulativeu64
4632026-01-23T16:59:46.173ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 22 table_name = measurements_histogramu64
4642026-01-23T16:59:46.174ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 40 table_name = measurements_u64
4652026-01-23T16:59:46.257ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
4662026-01-23T16:59:46.494ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4672026-01-23T16:59:46.494ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4682026-01-23T16:59:46.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4692026-01-23T16:59:46.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4702026-01-23T16:59:46.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4712026-01-23T16:59:46.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4722026-01-23T16:59:47.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4732026-01-23T16:59:47.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4742026-01-23T16:59:47.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4752026-01-23T16:59:47.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4762026-01-23T16:59:47.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4772026-01-23T16:59:47.500ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4782026-01-23T16:59:48.494ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4792026-01-23T16:59:48.494ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4802026-01-23T16:59:48.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4812026-01-23T16:59:48.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4822026-01-23T16:59:48.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4832026-01-23T16:59:48.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4842026-01-23T16:59:49.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4852026-01-23T16:59:49.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4862026-01-23T16:59:49.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4872026-01-23T16:59:49.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4882026-01-23T16:59:49.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4892026-01-23T16:59:49.500ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4902026-01-23T16:59:50.476ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
4912026-01-23T16:59:50.476ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/c6603d05-c0f8-4821-9ab1-f70212d2f47d/producers?sort_by=id_ascending
4922026-01-23T16:59:50.481ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/c6603d05-c0f8-4821-9ab1-f70212d2f47d/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "f46fd362-8a91-4e68-abfd-b6fe8c6d245b", "content-length": "859", "date": "Fri, 23 Jan 2026 16:59:50 GMT"} })
4932026-01-23T16:59:50.481ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/c6603d05-c0f8-4821-9ab1-f70212d2f47d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOTA3NjY5OC0yNWEyLTQwNDItYTFhOS1jZWZmN2IxOGRkYmUifX0%3D
4942026-01-23T16:59:50.483ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/c6603d05-c0f8-4821-9ab1-f70212d2f47d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOTA3NjY5OC0yNWEyLTQwNDItYTFhOS1jZWZmN2IxOGRkYmUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7cc51bf-ad0c-4866-81a1-04fa361c9add", "content-length": "29", "date": "Fri, 23 Jan 2026 16:59:50 GMT"} })
4952026-01-23T16:59:50.483ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 5 n_pruned_tasks = 0
4962026-01-23T16:59:50.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = cec3cf60-20e6-4909-8860-0c588996b211 producer_ip = fd00:1122:3344:101::2 producer_port = 47044
4972026-01-23T16:59:50.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4982026-01-23T16:59:50.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4992026-01-23T16:59:50.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = cec3cf60-20e6-4909-8860-0c588996b211 producer_ip = fd00:1122:3344:101::2 producer_port = 47044
5002026-01-23T16:59:50.495ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = cec3cf60-20e6-4909-8860-0c588996b211 producer_ip = fd00:1122:3344:101::2 producer_port = 47044
5012026-01-23T16:59:50.495ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5022026-01-23T16:59:50.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5032026-01-23T16:59:50.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5042026-01-23T16:59:50.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5052026-01-23T16:59:51.156ZDEBGoximeter (results-sink): inserting 160 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
5062026-01-23T16:59:51.156ZDEBGoximeter (results-sink-cluster): inserting 160 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
5072026-01-23T16:59:51.156ZDEBGoximeter (clickhouse-client): unrolling 160 total samples collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
5082026-01-23T16:59:51.168ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 50 table_name = fields_string
5092026-01-23T16:59:51.170ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 10 table_name = fields_u16
5102026-01-23T16:59:51.173ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 46 table_name = fields_uuid
5112026-01-23T16:59:51.175ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 110 table_name = measurements_cumulativeu64
5122026-01-23T16:59:51.178ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 10 table_name = measurements_histogramu64
5132026-01-23T16:59:51.181ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 40 table_name = measurements_u64
5142026-01-23T16:59:51.257ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
5152026-01-23T16:59:51.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5162026-01-23T16:59:51.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5172026-01-23T16:59:51.497ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5182026-01-23T16:59:51.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5192026-01-23T16:59:51.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5202026-01-23T16:59:51.500ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5212026-01-23T16:59:52.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5222026-01-23T16:59:52.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5232026-01-23T16:59:52.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5242026-01-23T16:59:52.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5252026-01-23T16:59:52.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5262026-01-23T16:59:52.500ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5272026-01-23T16:59:53.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5282026-01-23T16:59:53.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5292026-01-23T16:59:53.495ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5302026-01-23T16:59:53.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5312026-01-23T16:59:53.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5322026-01-23T16:59:53.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5332026-01-23T16:59:54.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5342026-01-23T16:59:54.494ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5352026-01-23T16:59:54.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5362026-01-23T16:59:54.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5372026-01-23T16:59:54.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5382026-01-23T16:59:54.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5392026-01-23T16:59:55.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5402026-01-23T16:59:55.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5412026-01-23T16:59:55.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5422026-01-23T16:59:55.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 0bdd34df-512d-451e-8f1b-918a39ad7eed producer_ip = fd00:1122:3344:101::a producer_port = 60482
5432026-01-23T16:59:55.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 0bdd34df-512d-451e-8f1b-918a39ad7eed producer_ip = fd00:1122:3344:101::a producer_port = 60482
5442026-01-23T16:59:55.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5452026-01-23T16:59:55.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5462026-01-23T16:59:55.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5472026-01-23T16:59:55.502ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 0bdd34df-512d-451e-8f1b-918a39ad7eed producer_ip = fd00:1122:3344:101::a producer_port = 60482
5482026-01-23T16:59:56.155ZDEBGoximeter (results-sink): inserting 173 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
5492026-01-23T16:59:56.155ZDEBGoximeter (results-sink-cluster): inserting 173 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
5502026-01-23T16:59:56.155ZDEBGoximeter (clickhouse-client): unrolling 173 total samples collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
5512026-01-23T16:59:56.164ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 76 table_name = fields_string
5522026-01-23T16:59:56.166ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 23 table_name = fields_u16
5532026-01-23T16:59:56.168ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 59 table_name = fields_uuid
5542026-01-23T16:59:56.170ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 110 table_name = measurements_cumulativeu64
5552026-01-23T16:59:56.172ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 23 table_name = measurements_histogramu64
5562026-01-23T16:59:56.174ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 40 table_name = measurements_u64
5572026-01-23T16:59:56.256ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
5582026-01-23T16:59:56.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5592026-01-23T16:59:56.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5602026-01-23T16:59:56.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5612026-01-23T16:59:56.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5622026-01-23T16:59:56.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5632026-01-23T16:59:56.500ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5642026-01-23T16:59:57.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5652026-01-23T16:59:57.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5662026-01-23T16:59:57.495ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5672026-01-23T16:59:57.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5682026-01-23T16:59:57.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5692026-01-23T16:59:57.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5702026-01-23T16:59:58.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5712026-01-23T16:59:58.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5722026-01-23T16:59:58.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5732026-01-23T16:59:58.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5742026-01-23T16:59:58.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5752026-01-23T16:59:58.500ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5762026-01-23T16:59:59.494ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5772026-01-23T16:59:59.494ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5782026-01-23T16:59:59.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5792026-01-23T16:59:59.498ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5802026-01-23T16:59:59.498ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5812026-01-23T16:59:59.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5822026-01-23T17:00:00.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = cec3cf60-20e6-4909-8860-0c588996b211 producer_ip = fd00:1122:3344:101::2 producer_port = 47044
5832026-01-23T17:00:00.493ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5842026-01-23T17:00:00.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = cec3cf60-20e6-4909-8860-0c588996b211 producer_ip = fd00:1122:3344:101::2 producer_port = 47044
5852026-01-23T17:00:00.493ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5862026-01-23T17:00:00.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = cec3cf60-20e6-4909-8860-0c588996b211 producer_ip = fd00:1122:3344:101::2 producer_port = 47044
5872026-01-23T17:00:00.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5882026-01-23T17:00:00.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5892026-01-23T17:00:00.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5902026-01-23T17:00:00.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5912026-01-23T17:00:01.156ZDEBGoximeter (results-sink): inserting 160 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
5922026-01-23T17:00:01.156ZDEBGoximeter (results-sink-cluster): inserting 160 samples into database collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d
5932026-01-23T17:00:01.156ZDEBGoximeter (clickhouse-client): unrolling 160 total samples collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76
5942026-01-23T17:00:01.166ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 50 table_name = fields_string
5952026-01-23T17:00:01.168ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 10 table_name = fields_u16
5962026-01-23T17:00:01.169ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 46 table_name = fields_uuid
5972026-01-23T17:00:01.171ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 110 table_name = measurements_cumulativeu64
5982026-01-23T17:00:01.173ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 10 table_name = measurements_histogramu64
5992026-01-23T17:00:01.175ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d id = aa39de1e-a933-4c61-b341-19e340756d76 n_rows = 40 table_name = measurements_u64
6002026-01-23T17:00:01.257ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
6012026-01-23T17:00:01.494ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6022026-01-23T17:00:01.494ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6032026-01-23T17:00:01.496ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8cb2b947-dd65-4fa5-8af1-fee3802cff52 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6042026-01-23T17:00:01.499ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6052026-01-23T17:00:01.499ZDEBGoximeter (collection-task): collecting from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6062026-01-23T17:00:01.499ZDEBGoximeter (collection-task): collected results from producer collector_id = c6603d05-c0f8-4821-9ab1-f70212d2f47d collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d9076698-25a2-4042-a1a9-ceff7b18ddbe producer_ip = fd00:1122:3344:101::2 producer_port = 4677