Max level shown:
1 [ May 21 17:28:10 Enabled. ]
2 [ May 21 17:28:10 Rereading configuration. ]
3 [ May 21 17:28:12 Rereading configuration. ]
4 [ May 21 17:28:15 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 &"). ]
5 [ May 21 17:28:15 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-05-21T17:28:15.406ZDEBGoximeter: registered DTrace probes
82026-05-21T17:28:15.410ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:301
92026-05-21T17:28:15.410ZDEBGoximeter: creating ClickHouse client
102026-05-21T17:28:15.424ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
112026-05-21T17:28:22.736ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:890 id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
122026-05-21T17:28:22.736ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d
132026-05-21T17:28:22.736ZINFOoximeter (clickhouse-client): reading db version collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:790 id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
142026-05-21T17:28:22.738ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:890 id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
152026-05-21T17:28:22.738ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:795 id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 version = 0
162026-05-21T17:28:22.738ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:800 id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
172026-05-21T17:28:22.738ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
182026-05-21T17:28:23.771ZINFOoximeter (clickhouse-client): inserting current version collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:821 id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 version = 14
192026-05-21T17:28:23.826ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 8980ca55-486a-4b3c-8245-7b73a00cf45d
202026-05-21T17:28:23.870ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-05-21T17:28:23.870ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-05-21T17:28:23.870ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-05-21T17:28:23.870ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-05-21T17:28:23.870ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.0/src/server.rs:335 local_addr = [fd00:1122:3344:101::d]:12223
252026-05-21T17:28:23.884ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-05-21T17:28:23.884ZDEBGoximeter: registered USDT probes
272026-05-21T17:28:23.885ZDEBGoximeter: contacting nexus
282026-05-21T17:28:23.965ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
292026-05-21T17:28:24.223ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "c1fb5308-52b5-4c44-a29b-ef133d8fbd12", "date": "Thu, 21 May 2026 17:28:24 GMT"} })
302026-05-21T17:28:24.224ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:464 id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8
312026-05-21T17:28:24.224ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
322026-05-21T17:28:24.225ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
332026-05-21T17:28:24.229ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?sort_by=id_ascending
342026-05-21T17:28:24.283ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "29595d77-98b5-4c7b-bdfb-eb827b085a72", "content-length": "29", "date": "Thu, 21 May 2026 17:28:24 GMT"} })
352026-05-21T17:28:24.283ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 0 n_pruned_tasks = 0
362026-05-21T17:28:28.827ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d
372026-05-21T17:28:28.827ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d
382026-05-21T17:28:33.827ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d
392026-05-21T17:28:33.827ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d
402026-05-21T17:28:38.827ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d
412026-05-21T17:28:38.827ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d
422026-05-21T17:28:39.224ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
432026-05-21T17:28:39.224ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?sort_by=id_ascending
442026-05-21T17:28:39.242ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "42d1a288-58dc-4f54-90f9-815f31199cea", "content-length": "439", "date": "Thu, 21 May 2026 17:28:39 GMT"} })
452026-05-21T17:28:39.244ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYmZjODA3Yy04NDg1LTRlMmEtYjFhNS1lMzBlY2Q0ZjM5MjYifX0%3D
462026-05-21T17:28:39.247ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYmZjODA3Yy04NDg1LTRlMmEtYjFhNS1lMzBlY2Q0ZjM5MjYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "4792cd70-6894-4af6-84c2-9ba42be74620", "content-length": "29", "date": "Thu, 21 May 2026 17:28:39 GMT"} })
472026-05-21T17:28:39.247ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba
482026-05-21T17:28:39.247ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:45398 collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = abfc807c-8485-4e2a-b1a5-e30ecd4f3926
492026-05-21T17:28:39.247ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 2 n_pruned_tasks = 0
502026-05-21T17:28:39.248ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
512026-05-21T17:28:39.248ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = abfc807c-8485-4e2a-b1a5-e30ecd4f3926 producer_ip = fd00:1122:3344:101::1 producer_port = 45398
522026-05-21T17:28:39.248ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = abfc807c-8485-4e2a-b1a5-e30ecd4f3926 producer_ip = fd00:1122:3344:101::1 producer_port = 45398
532026-05-21T17:28:39.248ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = abfc807c-8485-4e2a-b1a5-e30ecd4f3926 producer_ip = fd00:1122:3344:101::1 producer_port = 45398
542026-05-21T17:28:39.282ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
552026-05-21T17:28:39.282ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
562026-05-21T17:28:39.290ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
572026-05-21T17:28:39.382ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 2191 producer_id = abfc807c-8485-4e2a-b1a5-e30ecd4f3926 producer_ip = fd00:1122:3344:101::1 producer_port = 45398
582026-05-21T17:28:39.394ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 2207
592026-05-21T17:28:39.394ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 2207
602026-05-21T17:28:39.394ZDEBGoximeter (clickhouse-client): unrolling 2207 total samples collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
612026-05-21T17:28:39.458ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
622026-05-21T17:28:39.468ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.396675079Z } timeseries_name = ddm_router:originated_tunnel_endpoints
632026-05-21T17:28:39.468ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.396579607Z } timeseries_name = ddm_router:originated_underlay_prefixes
642026-05-21T17:28:39.468ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.396924853Z } timeseries_name = ddm_session:advertisements_received
652026-05-21T17:28:39.468ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.396866742Z } timeseries_name = ddm_session:advertisements_sent
662026-05-21T17:28:39.468ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.397458522Z } timeseries_name = ddm_session:imported_tunnel_endpoints
672026-05-21T17:28:39.468ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.397395391Z } timeseries_name = ddm_session:imported_underlay_prefixes
682026-05-21T17:28:39.468ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.397041985Z } timeseries_name = ddm_session:peer_address_changes
692026-05-21T17:28:39.468ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.396982454Z } timeseries_name = ddm_session:peer_expirations
702026-05-21T17:28:39.468ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.397125487Z } timeseries_name = ddm_session:peer_sessions_established
712026-05-21T17:28:39.469ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.396802871Z } timeseries_name = ddm_session:solicitations_received
722026-05-21T17:28:39.469ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.396744090Z } timeseries_name = ddm_session:solicitations_sent
732026-05-21T17:28:39.469ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.397327910Z } timeseries_name = ddm_session:update_send_fail
742026-05-21T17:28:39.469ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.397265419Z } timeseries_name = ddm_session:updates_received
752026-05-21T17:28:39.469ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.397185768Z } timeseries_name = ddm_session:updates_sent
762026-05-21T17:28:39.469ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.458637227Z } timeseries_name = http_service:request_latency_histogram
772026-05-21T17:28:39.469ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("kstat_sampler:expired_targets"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.458029196Z } timeseries_name = kstat_sampler:expired_targets
782026-05-21T17:28:39.469ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("kstat_sampler:samples_dropped"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "target_id", field_type: U64, source: Metric, description: "" }, FieldSchema { name: "target_name", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.458265760Z } timeseries_name = kstat_sampler:samples_dropped
792026-05-21T17:28:39.469ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.396446655Z } timeseries_name = oximeter_collector:collections
802026-05-21T17:28:39.469ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_cpu:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "cpu_id", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.409524558Z } timeseries_name = sled_cpu:cpu_nsec
812026-05-21T17:28:39.469ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.397634066Z } timeseries_name = sled_data_link:bytes_received
822026-05-21T17:28:39.469ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.397751728Z } timeseries_name = sled_data_link:bytes_sent
832026-05-21T17:28:39.469ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.397517503Z } timeseries_name = sled_data_link:errors_received
842026-05-21T17:28:39.469ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.397575565Z } timeseries_name = sled_data_link:errors_sent
852026-05-21T17:28:39.469ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.397693557Z } timeseries_name = sled_data_link:packets_received
862026-05-21T17:28:39.469ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.397809489Z } timeseries_name = sled_data_link:packets_sent
872026-05-21T17:28:39.469ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zone:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_type", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:39.423694732Z } timeseries_name = zone:cpu_nsec
882026-05-21T17:28:39.487ZDEBGoximeter (clickhouse-client): inserting 26 new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
892026-05-21T17:28:39.497ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
902026-05-21T17:28:39.498ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 4 table_name = fields_ipaddr
912026-05-21T17:28:39.501ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 2362 table_name = fields_string
922026-05-21T17:28:39.503ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 6 table_name = fields_u16
932026-05-21T17:28:39.505ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 801 table_name = fields_u32
942026-05-21T17:28:39.507ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 2 table_name = fields_u64
952026-05-21T17:28:39.510ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 1249 table_name = fields_uuid
962026-05-21T17:28:39.512ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 2201 table_name = measurements_cumulativeu64
972026-05-21T17:28:39.515ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 2 table_name = measurements_histogramu64
982026-05-21T17:28:39.516ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 4 table_name = measurements_u64
992026-05-21T17:28:40.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1002026-05-21T17:28:40.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1012026-05-21T17:28:40.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1022026-05-21T17:28:41.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1032026-05-21T17:28:41.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1042026-05-21T17:28:41.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1052026-05-21T17:28:42.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1062026-05-21T17:28:42.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1072026-05-21T17:28:42.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1082026-05-21T17:28:43.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1092026-05-21T17:28:43.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1102026-05-21T17:28:43.285ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1112026-05-21T17:28:43.827ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 56
1122026-05-21T17:28:43.827ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 56
1132026-05-21T17:28:43.828ZDEBGoximeter (clickhouse-client): unrolling 56 total samples collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
1142026-05-21T17:28:43.830ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
1152026-05-21T17:28:43.876ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 26 table_name = fields_string
1162026-05-21T17:28:43.878ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 28 table_name = fields_uuid
1172026-05-21T17:28:43.880ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 40 table_name = measurements_cumulativeu64
1182026-05-21T17:28:43.883ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 16 table_name = measurements_u64
1192026-05-21T17:28:43.929ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
1202026-05-21T17:28:44.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1212026-05-21T17:28:44.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1222026-05-21T17:28:44.285ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1232026-05-21T17:28:45.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1242026-05-21T17:28:45.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1252026-05-21T17:28:45.285ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1262026-05-21T17:28:46.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1272026-05-21T17:28:46.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1282026-05-21T17:28:46.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1292026-05-21T17:28:47.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1302026-05-21T17:28:47.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1312026-05-21T17:28:47.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1322026-05-21T17:28:48.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1332026-05-21T17:28:48.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1342026-05-21T17:28:48.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1352026-05-21T17:28:48.828ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 70
1362026-05-21T17:28:48.828ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 70
1372026-05-21T17:28:48.828ZDEBGoximeter (clickhouse-client): unrolling 70 total samples collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
1382026-05-21T17:28:48.830ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
1392026-05-21T17:28:48.836ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 26 table_name = fields_string
1402026-05-21T17:28:48.838ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 28 table_name = fields_uuid
1412026-05-21T17:28:48.840ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 50 table_name = measurements_cumulativeu64
1422026-05-21T17:28:48.843ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 20 table_name = measurements_u64
1432026-05-21T17:28:48.929ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
1442026-05-21T17:28:49.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1452026-05-21T17:28:49.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1462026-05-21T17:28:49.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1472026-05-21T17:28:50.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1482026-05-21T17:28:50.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1492026-05-21T17:28:50.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1502026-05-21T17:28:51.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1512026-05-21T17:28:51.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1522026-05-21T17:28:51.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1532026-05-21T17:28:52.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1542026-05-21T17:28:52.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1552026-05-21T17:28:52.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1562026-05-21T17:28:53.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1572026-05-21T17:28:53.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1582026-05-21T17:28:53.285ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1592026-05-21T17:28:53.829ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 70
1602026-05-21T17:28:53.829ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 70
1612026-05-21T17:28:53.829ZDEBGoximeter (clickhouse-client): unrolling 70 total samples collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
1622026-05-21T17:28:53.831ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
1632026-05-21T17:28:53.837ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 26 table_name = fields_string
1642026-05-21T17:28:53.838ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 28 table_name = fields_uuid
1652026-05-21T17:28:53.840ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 50 table_name = measurements_cumulativeu64
1662026-05-21T17:28:53.842ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 20 table_name = measurements_u64
1672026-05-21T17:28:53.929ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
1682026-05-21T17:28:54.225ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
1692026-05-21T17:28:54.225ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?sort_by=id_ascending
1702026-05-21T17:28:54.228ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ea5ef20-f22d-4cec-96f1-c14ca0154a1b", "content-length": "713", "date": "Thu, 21 May 2026 17:28:54 GMT"} })
1712026-05-21T17:28:54.228ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYmZjODA3Yy04NDg1LTRlMmEtYjFhNS1lMzBlY2Q0ZjM5MjYifX0%3D
1722026-05-21T17:28:54.230ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYmZjODA3Yy04NDg1LTRlMmEtYjFhNS1lMzBlY2Q0ZjM5MjYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba6bf1c4-0dae-43c0-8e79-bcc6d138316e", "content-length": "29", "date": "Thu, 21 May 2026 17:28:54 GMT"} })
1732026-05-21T17:28:54.230ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:51333 collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82
1742026-05-21T17:28:54.230ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63
1752026-05-21T17:28:54.231ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 4 n_pruned_tasks = 0
1762026-05-21T17:28:54.232ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82 producer_ip = fd00:1122:3344:101::c producer_port = 51333
1772026-05-21T17:28:54.232ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1782026-05-21T17:28:54.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82 producer_ip = fd00:1122:3344:101::c producer_port = 51333
1792026-05-21T17:28:54.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1802026-05-21T17:28:54.234ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1812026-05-21T17:28:54.234ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82 producer_ip = fd00:1122:3344:101::c producer_port = 51333
1822026-05-21T17:28:54.243ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 41 producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82 producer_ip = fd00:1122:3344:101::c producer_port = 51333
1832026-05-21T17:28:54.246ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1842026-05-21T17:28:54.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1852026-05-21T17:28:54.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1862026-05-21T17:28:54.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1872026-05-21T17:28:55.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1882026-05-21T17:28:55.231ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1892026-05-21T17:28:55.235ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1902026-05-21T17:28:55.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1912026-05-21T17:28:55.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1922026-05-21T17:28:55.285ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1932026-05-21T17:28:56.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1942026-05-21T17:28:56.231ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1952026-05-21T17:28:56.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1962026-05-21T17:28:56.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1972026-05-21T17:28:56.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1982026-05-21T17:28:56.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1992026-05-21T17:28:57.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2002026-05-21T17:28:57.231ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2012026-05-21T17:28:57.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2022026-05-21T17:28:57.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2032026-05-21T17:28:57.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2042026-05-21T17:28:57.285ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2052026-05-21T17:28:58.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2062026-05-21T17:28:58.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2072026-05-21T17:28:58.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2082026-05-21T17:28:58.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2092026-05-21T17:28:58.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2102026-05-21T17:28:58.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2112026-05-21T17:28:58.828ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 243
2122026-05-21T17:28:58.828ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 243
2132026-05-21T17:28:58.828ZDEBGoximeter (clickhouse-client): unrolling 243 total samples collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
2142026-05-21T17:28:58.836ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
2152026-05-21T17:28:58.840ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:58.829723558Z } timeseries_name = collection_target:cpus_provisioned
2162026-05-21T17:28:58.840ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:58.829793129Z } timeseries_name = collection_target:ram_provisioned
2172026-05-21T17:28:58.840ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:28:58.829863430Z } timeseries_name = collection_target:virtual_disk_space_provisioned
2182026-05-21T17:28:58.841ZDEBGoximeter (clickhouse-client): inserting 3 new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
2192026-05-21T17:28:58.845ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 4 table_name = fields_ipaddr
2202026-05-21T17:28:58.847ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 88 table_name = fields_string
2212026-05-21T17:28:58.848ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 21 table_name = fields_u16
2222026-05-21T17:28:58.850ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 95 table_name = fields_uuid
2232026-05-21T17:28:58.852ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 152 table_name = measurements_cumulativeu64
2242026-05-21T17:28:58.857ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 17 table_name = measurements_histogramu64
2252026-05-21T17:28:58.859ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 24 table_name = measurements_i64
2262026-05-21T17:28:58.860ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 50 table_name = measurements_u64
2272026-05-21T17:28:58.929ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
2282026-05-21T17:28:59.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2292026-05-21T17:28:59.231ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2302026-05-21T17:28:59.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2312026-05-21T17:28:59.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2322026-05-21T17:28:59.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2332026-05-21T17:28:59.285ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2342026-05-21T17:29:00.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2352026-05-21T17:29:00.231ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2362026-05-21T17:29:00.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2372026-05-21T17:29:00.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2382026-05-21T17:29:00.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2392026-05-21T17:29:00.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2402026-05-21T17:29:01.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2412026-05-21T17:29:01.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2422026-05-21T17:29:01.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2432026-05-21T17:29:01.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2442026-05-21T17:29:01.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2452026-05-21T17:29:01.285ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2462026-05-21T17:29:02.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2472026-05-21T17:29:02.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2482026-05-21T17:29:02.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2492026-05-21T17:29:02.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2502026-05-21T17:29:02.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2512026-05-21T17:29:02.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2522026-05-21T17:29:03.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2532026-05-21T17:29:03.231ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2542026-05-21T17:29:03.233ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2552026-05-21T17:29:03.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2562026-05-21T17:29:03.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2572026-05-21T17:29:03.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2582026-05-21T17:29:03.828ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 200
2592026-05-21T17:29:03.828ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 200
2602026-05-21T17:29:03.828ZDEBGoximeter (clickhouse-client): unrolling 200 total samples collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
2612026-05-21T17:29:03.834ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
2622026-05-21T17:29:03.841ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 52 table_name = fields_string
2632026-05-21T17:29:03.843ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 56 table_name = fields_uuid
2642026-05-21T17:29:03.845ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 150 table_name = measurements_cumulativeu64
2652026-05-21T17:29:03.847ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 50 table_name = measurements_u64
2662026-05-21T17:29:03.929ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
2672026-05-21T17:29:04.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2682026-05-21T17:29:04.231ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2692026-05-21T17:29:04.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82 producer_ip = fd00:1122:3344:101::c producer_port = 51333
2702026-05-21T17:29:04.231ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82 producer_ip = fd00:1122:3344:101::c producer_port = 51333
2712026-05-21T17:29:04.233ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2722026-05-21T17:29:04.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 25 producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82 producer_ip = fd00:1122:3344:101::c producer_port = 51333
2732026-05-21T17:29:04.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2742026-05-21T17:29:04.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2752026-05-21T17:29:04.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2762026-05-21T17:29:05.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2772026-05-21T17:29:05.231ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2782026-05-21T17:29:05.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2792026-05-21T17:29:05.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2802026-05-21T17:29:05.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2812026-05-21T17:29:05.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2822026-05-21T17:29:06.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2832026-05-21T17:29:06.231ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2842026-05-21T17:29:06.233ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2852026-05-21T17:29:06.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2862026-05-21T17:29:06.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2872026-05-21T17:29:06.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2882026-05-21T17:29:07.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2892026-05-21T17:29:07.231ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2902026-05-21T17:29:07.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2912026-05-21T17:29:07.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2922026-05-21T17:29:07.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2932026-05-21T17:29:07.287ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2942026-05-21T17:29:08.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2952026-05-21T17:29:08.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2962026-05-21T17:29:08.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2972026-05-21T17:29:08.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2982026-05-21T17:29:08.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2992026-05-21T17:29:08.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3002026-05-21T17:29:08.828ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 225
3012026-05-21T17:29:08.828ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 225
3022026-05-21T17:29:08.828ZDEBGoximeter (clickhouse-client): unrolling 225 total samples collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
3032026-05-21T17:29:08.836ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
3042026-05-21T17:29:08.847ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 96 table_name = fields_string
3052026-05-21T17:29:08.849ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 22 table_name = fields_u16
3062026-05-21T17:29:08.851ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 81 table_name = fields_uuid
3072026-05-21T17:29:08.853ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 150 table_name = measurements_cumulativeu64
3082026-05-21T17:29:08.855ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 22 table_name = measurements_histogramu64
3092026-05-21T17:29:08.857ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 3 table_name = measurements_i64
3102026-05-21T17:29:08.858ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 50 table_name = measurements_u64
3112026-05-21T17:29:08.930ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
3122026-05-21T17:29:09.226ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
3132026-05-21T17:29:09.226ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?sort_by=id_ascending
3142026-05-21T17:29:09.229ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4ff1c82-f9e9-41cb-b6e9-82957a99e245", "content-length": "713", "date": "Thu, 21 May 2026 17:29:09 GMT"} })
3152026-05-21T17:29:09.229ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYmZjODA3Yy04NDg1LTRlMmEtYjFhNS1lMzBlY2Q0ZjM5MjYifX0%3D
3162026-05-21T17:29:09.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3172026-05-21T17:29:09.231ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3182026-05-21T17:29:09.232ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYmZjODA3Yy04NDg1LTRlMmEtYjFhNS1lMzBlY2Q0ZjM5MjYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "94c4311a-1f72-47c8-9286-4429916d8cc6", "content-length": "29", "date": "Thu, 21 May 2026 17:29:09 GMT"} })
3192026-05-21T17:29:09.232ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 4 n_pruned_tasks = 0
3202026-05-21T17:29:09.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3212026-05-21T17:29:09.249ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = abfc807c-8485-4e2a-b1a5-e30ecd4f3926 producer_ip = fd00:1122:3344:101::1 producer_port = 45398
3222026-05-21T17:29:09.249ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = abfc807c-8485-4e2a-b1a5-e30ecd4f3926 producer_ip = fd00:1122:3344:101::1 producer_port = 45398
3232026-05-21T17:29:09.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3242026-05-21T17:29:09.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3252026-05-21T17:29:09.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3262026-05-21T17:29:09.316ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 1472 producer_id = abfc807c-8485-4e2a-b1a5-e30ecd4f3926 producer_ip = fd00:1122:3344:101::1 producer_port = 45398
3272026-05-21T17:29:09.321ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 1512
3282026-05-21T17:29:09.321ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 1512
3292026-05-21T17:29:09.321ZDEBGoximeter (clickhouse-client): unrolling 1512 total samples collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
3302026-05-21T17:29:09.364ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
3312026-05-21T17:29:09.381ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 2395 table_name = fields_string
3322026-05-21T17:29:09.383ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 8 table_name = fields_u16
3332026-05-21T17:29:09.385ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 801 table_name = fields_u32
3342026-05-21T17:29:09.387ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 1 table_name = fields_u64
3352026-05-21T17:29:09.390ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 1279 table_name = fields_uuid
3362026-05-21T17:29:09.392ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 1494 table_name = measurements_cumulativeu64
3372026-05-21T17:29:09.395ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 8 table_name = measurements_histogramu64
3382026-05-21T17:29:09.397ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 10 table_name = measurements_u64
3392026-05-21T17:29:09.423ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
3402026-05-21T17:29:10.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3412026-05-21T17:29:10.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3422026-05-21T17:29:10.235ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3432026-05-21T17:29:10.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3442026-05-21T17:29:10.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3452026-05-21T17:29:10.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3462026-05-21T17:29:11.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3472026-05-21T17:29:11.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3482026-05-21T17:29:11.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3492026-05-21T17:29:11.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3502026-05-21T17:29:11.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3512026-05-21T17:29:11.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3522026-05-21T17:29:12.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3532026-05-21T17:29:12.231ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3542026-05-21T17:29:12.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3552026-05-21T17:29:12.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3562026-05-21T17:29:12.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3572026-05-21T17:29:12.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3582026-05-21T17:29:13.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3592026-05-21T17:29:13.231ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3602026-05-21T17:29:13.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3612026-05-21T17:29:13.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3622026-05-21T17:29:13.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3632026-05-21T17:29:13.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3642026-05-21T17:29:13.828ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 160
3652026-05-21T17:29:13.828ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 160
3662026-05-21T17:29:13.828ZDEBGoximeter (clickhouse-client): unrolling 160 total samples collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
3672026-05-21T17:29:13.834ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
3682026-05-21T17:29:13.840ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 52 table_name = fields_string
3692026-05-21T17:29:13.842ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 56 table_name = fields_uuid
3702026-05-21T17:29:13.844ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 120 table_name = measurements_cumulativeu64
3712026-05-21T17:29:13.845ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 40 table_name = measurements_u64
3722026-05-21T17:29:13.930ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
3732026-05-21T17:29:14.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3742026-05-21T17:29:14.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3752026-05-21T17:29:14.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82 producer_ip = fd00:1122:3344:101::c producer_port = 51333
3762026-05-21T17:29:14.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82 producer_ip = fd00:1122:3344:101::c producer_port = 51333
3772026-05-21T17:29:14.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3782026-05-21T17:29:14.235ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 22 producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82 producer_ip = fd00:1122:3344:101::c producer_port = 51333
3792026-05-21T17:29:14.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3802026-05-21T17:29:14.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3812026-05-21T17:29:14.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3822026-05-21T17:29:15.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3832026-05-21T17:29:15.231ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3842026-05-21T17:29:15.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3852026-05-21T17:29:15.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3862026-05-21T17:29:15.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3872026-05-21T17:29:15.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3882026-05-21T17:29:16.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3892026-05-21T17:29:16.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3902026-05-21T17:29:16.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3912026-05-21T17:29:16.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3922026-05-21T17:29:16.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3932026-05-21T17:29:16.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3942026-05-21T17:29:17.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3952026-05-21T17:29:17.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3962026-05-21T17:29:17.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3972026-05-21T17:29:17.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3982026-05-21T17:29:17.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3992026-05-21T17:29:17.287ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4002026-05-21T17:29:18.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4012026-05-21T17:29:18.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4022026-05-21T17:29:18.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4032026-05-21T17:29:18.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4042026-05-21T17:29:18.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4052026-05-21T17:29:18.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4062026-05-21T17:29:18.828ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 222
4072026-05-21T17:29:18.829ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 222
4082026-05-21T17:29:18.829ZDEBGoximeter (clickhouse-client): unrolling 222 total samples collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
4092026-05-21T17:29:18.836ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
4102026-05-21T17:29:18.842ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 96 table_name = fields_string
4112026-05-21T17:29:18.844ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 22 table_name = fields_u16
4122026-05-21T17:29:18.846ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 78 table_name = fields_uuid
4132026-05-21T17:29:18.848ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 150 table_name = measurements_cumulativeu64
4142026-05-21T17:29:18.850ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 22 table_name = measurements_histogramu64
4152026-05-21T17:29:18.852ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 50 table_name = measurements_u64
4162026-05-21T17:29:18.930ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
4172026-05-21T17:29:19.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4182026-05-21T17:29:19.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4192026-05-21T17:29:19.235ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4202026-05-21T17:29:19.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4212026-05-21T17:29:19.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4222026-05-21T17:29:19.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4232026-05-21T17:29:20.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4242026-05-21T17:29:20.231ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4252026-05-21T17:29:20.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4262026-05-21T17:29:20.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4272026-05-21T17:29:20.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4282026-05-21T17:29:20.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4292026-05-21T17:29:21.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4302026-05-21T17:29:21.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4312026-05-21T17:29:21.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4322026-05-21T17:29:21.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4332026-05-21T17:29:21.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4342026-05-21T17:29:21.287ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4352026-05-21T17:29:22.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4362026-05-21T17:29:22.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4372026-05-21T17:29:22.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4382026-05-21T17:29:22.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4392026-05-21T17:29:22.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4402026-05-21T17:29:22.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4412026-05-21T17:29:23.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4422026-05-21T17:29:23.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4432026-05-21T17:29:23.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4442026-05-21T17:29:23.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4452026-05-21T17:29:23.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4462026-05-21T17:29:23.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4472026-05-21T17:29:23.829ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 200
4482026-05-21T17:29:23.829ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 200
4492026-05-21T17:29:23.829ZDEBGoximeter (clickhouse-client): unrolling 200 total samples collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
4502026-05-21T17:29:23.835ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
4512026-05-21T17:29:23.841ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 52 table_name = fields_string
4522026-05-21T17:29:23.843ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 56 table_name = fields_uuid
4532026-05-21T17:29:23.845ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 150 table_name = measurements_cumulativeu64
4542026-05-21T17:29:23.847ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 50 table_name = measurements_u64
4552026-05-21T17:29:23.930ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
4562026-05-21T17:29:24.225ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
4572026-05-21T17:29:24.225ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?sort_by=id_ascending
4582026-05-21T17:29:24.228ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a0f414c-0fcd-4d81-8817-13fbf680204b", "content-length": "1000", "date": "Thu, 21 May 2026 17:29:24 GMT"} })
4592026-05-21T17:29:24.228ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYmZjODA3Yy04NDg1LTRlMmEtYjFhNS1lMzBlY2Q0ZjM5MjYifX0%3D
4602026-05-21T17:29:24.231ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYmZjODA3Yy04NDg1LTRlMmEtYjFhNS1lMzBlY2Q0ZjM5MjYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8e10bc5-699d-46a8-91b2-9b8274e38aa3", "content-length": "29", "date": "Thu, 21 May 2026 17:29:24 GMT"} })
4612026-05-21T17:29:24.231ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:59932 collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 5be102f7-8320-4ece-b241-c1828c196ac4
4622026-05-21T17:29:24.231ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:58573 collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = a723d9dc-00e6-4234-b03d-315f8903a755
4632026-05-21T17:29:24.231ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 6 n_pruned_tasks = 0
4642026-05-21T17:29:24.232ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = a723d9dc-00e6-4234-b03d-315f8903a755 producer_ip = fd00:1122:3344:101::2 producer_port = 58573
4652026-05-21T17:29:24.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4662026-05-21T17:29:24.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4672026-05-21T17:29:24.232ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 5be102f7-8320-4ece-b241-c1828c196ac4 producer_ip = fd00:1122:3344:101::2 producer_port = 59932
4682026-05-21T17:29:24.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82 producer_ip = fd00:1122:3344:101::c producer_port = 51333
4692026-05-21T17:29:24.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82 producer_ip = fd00:1122:3344:101::c producer_port = 51333
4702026-05-21T17:29:24.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = a723d9dc-00e6-4234-b03d-315f8903a755 producer_ip = fd00:1122:3344:101::2 producer_port = 58573
4712026-05-21T17:29:24.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = a723d9dc-00e6-4234-b03d-315f8903a755 producer_ip = fd00:1122:3344:101::2 producer_port = 58573
4722026-05-21T17:29:24.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 5be102f7-8320-4ece-b241-c1828c196ac4 producer_ip = fd00:1122:3344:101::2 producer_port = 59932
4732026-05-21T17:29:24.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 5be102f7-8320-4ece-b241-c1828c196ac4 producer_ip = fd00:1122:3344:101::2 producer_port = 59932
4742026-05-21T17:29:24.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4752026-05-21T17:29:24.236ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 22 producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82 producer_ip = fd00:1122:3344:101::c producer_port = 51333
4762026-05-21T17:29:24.244ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = a723d9dc-00e6-4234-b03d-315f8903a755 producer_ip = fd00:1122:3344:101::2 producer_port = 58573
4772026-05-21T17:29:24.273ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 288 producer_id = 5be102f7-8320-4ece-b241-c1828c196ac4 producer_ip = fd00:1122:3344:101::2 producer_port = 59932
4782026-05-21T17:29:24.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4792026-05-21T17:29:24.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4802026-05-21T17:29:24.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4812026-05-21T17:29:25.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4822026-05-21T17:29:25.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4832026-05-21T17:29:25.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4842026-05-21T17:29:25.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4852026-05-21T17:29:25.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4862026-05-21T17:29:25.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4872026-05-21T17:29:26.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4882026-05-21T17:29:26.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4892026-05-21T17:29:26.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4902026-05-21T17:29:26.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4912026-05-21T17:29:26.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4922026-05-21T17:29:26.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4932026-05-21T17:29:27.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4942026-05-21T17:29:27.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4952026-05-21T17:29:27.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4962026-05-21T17:29:27.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4972026-05-21T17:29:27.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4982026-05-21T17:29:27.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4992026-05-21T17:29:28.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5002026-05-21T17:29:28.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5012026-05-21T17:29:28.235ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5022026-05-21T17:29:28.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5032026-05-21T17:29:28.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5042026-05-21T17:29:28.287ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5052026-05-21T17:29:28.829ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 523
5062026-05-21T17:29:28.829ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 523
5072026-05-21T17:29:28.829ZDEBGoximeter (clickhouse-client): unrolling 523 total samples collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
5082026-05-21T17:29:28.845ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
5092026-05-21T17:29:28.849ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:29:28.832226919Z } timeseries_name = switch_port_control_data_link:bytes_received
5102026-05-21T17:29:28.849ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:29:28.832353101Z } timeseries_name = switch_port_control_data_link:bytes_sent
5112026-05-21T17:29:28.849ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:29:28.832098317Z } timeseries_name = switch_port_control_data_link:errors_received
5122026-05-21T17:29:28.849ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:29:28.832164808Z } timeseries_name = switch_port_control_data_link:errors_sent
5132026-05-21T17:29:28.849ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:29:28.832290890Z } timeseries_name = switch_port_control_data_link:packets_received
5142026-05-21T17:29:28.849ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:29:28.832415003Z } timeseries_name = switch_port_control_data_link:packets_sent
5152026-05-21T17:29:28.855ZDEBGoximeter (clickhouse-client): inserting 6 new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
5162026-05-21T17:29:28.859ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 24 table_name = fields_i16
5172026-05-21T17:29:28.860ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 4 table_name = fields_ipaddr
5182026-05-21T17:29:28.862ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 240 table_name = fields_string
5192026-05-21T17:29:28.863ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 49 table_name = fields_u16
5202026-05-21T17:29:28.865ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 24 table_name = fields_u32
5212026-05-21T17:29:28.866ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 12 table_name = fields_u8
5222026-05-21T17:29:28.868ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 129 table_name = fields_uuid
5232026-05-21T17:29:28.869ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 440 table_name = measurements_cumulativeu64
5242026-05-21T17:29:28.872ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 33 table_name = measurements_histogramu64
5252026-05-21T17:29:28.873ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 50 table_name = measurements_u64
5262026-05-21T17:29:28.930ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
5272026-05-21T17:29:29.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5282026-05-21T17:29:29.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5292026-05-21T17:29:29.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5302026-05-21T17:29:29.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5312026-05-21T17:29:29.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5322026-05-21T17:29:29.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5332026-05-21T17:29:30.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5342026-05-21T17:29:30.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5352026-05-21T17:29:30.235ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5362026-05-21T17:29:30.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5372026-05-21T17:29:30.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5382026-05-21T17:29:30.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5392026-05-21T17:29:31.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5402026-05-21T17:29:31.231ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5412026-05-21T17:29:31.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5422026-05-21T17:29:31.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5432026-05-21T17:29:31.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5442026-05-21T17:29:31.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5452026-05-21T17:29:32.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5462026-05-21T17:29:32.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5472026-05-21T17:29:32.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5482026-05-21T17:29:32.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5492026-05-21T17:29:32.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5502026-05-21T17:29:32.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5512026-05-21T17:29:33.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5522026-05-21T17:29:33.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5532026-05-21T17:29:33.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5542026-05-21T17:29:33.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5552026-05-21T17:29:33.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5562026-05-21T17:29:33.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5572026-05-21T17:29:33.828ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 200
5582026-05-21T17:29:33.828ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 200
5592026-05-21T17:29:33.828ZDEBGoximeter (clickhouse-client): unrolling 200 total samples collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
5602026-05-21T17:29:33.835ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
5612026-05-21T17:29:33.844ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 52 table_name = fields_string
5622026-05-21T17:29:33.846ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 56 table_name = fields_uuid
5632026-05-21T17:29:33.847ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 150 table_name = measurements_cumulativeu64
5642026-05-21T17:29:33.848ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 50 table_name = measurements_u64
5652026-05-21T17:29:33.930ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
5662026-05-21T17:29:34.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5672026-05-21T17:29:34.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5682026-05-21T17:29:34.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82 producer_ip = fd00:1122:3344:101::c producer_port = 51333
5692026-05-21T17:29:34.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82 producer_ip = fd00:1122:3344:101::c producer_port = 51333
5702026-05-21T17:29:34.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = a723d9dc-00e6-4234-b03d-315f8903a755 producer_ip = fd00:1122:3344:101::2 producer_port = 58573
5712026-05-21T17:29:34.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = a723d9dc-00e6-4234-b03d-315f8903a755 producer_ip = fd00:1122:3344:101::2 producer_port = 58573
5722026-05-21T17:29:34.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = a723d9dc-00e6-4234-b03d-315f8903a755 producer_ip = fd00:1122:3344:101::2 producer_port = 58573
5732026-05-21T17:29:34.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5742026-05-21T17:29:34.235ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82 producer_ip = fd00:1122:3344:101::c producer_port = 51333
5752026-05-21T17:29:34.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5762026-05-21T17:29:34.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5772026-05-21T17:29:34.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5782026-05-21T17:29:35.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5792026-05-21T17:29:35.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5802026-05-21T17:29:35.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5812026-05-21T17:29:35.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5822026-05-21T17:29:35.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5832026-05-21T17:29:35.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5842026-05-21T17:29:36.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5852026-05-21T17:29:36.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5862026-05-21T17:29:36.235ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5872026-05-21T17:29:36.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5882026-05-21T17:29:36.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5892026-05-21T17:29:36.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5902026-05-21T17:29:37.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5912026-05-21T17:29:37.231ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5922026-05-21T17:29:37.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5932026-05-21T17:29:37.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5942026-05-21T17:29:37.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5952026-05-21T17:29:37.287ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5962026-05-21T17:29:38.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5972026-05-21T17:29:38.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5982026-05-21T17:29:38.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5992026-05-21T17:29:38.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6002026-05-21T17:29:38.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6012026-05-21T17:29:38.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6022026-05-21T17:29:38.828ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 234
6032026-05-21T17:29:38.828ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 234
6042026-05-21T17:29:38.828ZDEBGoximeter (clickhouse-client): unrolling 234 total samples collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
6052026-05-21T17:29:38.836ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
6062026-05-21T17:29:38.842ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 120 table_name = fields_string
6072026-05-21T17:29:38.844ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 34 table_name = fields_u16
6082026-05-21T17:29:38.845ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 90 table_name = fields_uuid
6092026-05-21T17:29:38.846ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 150 table_name = measurements_cumulativeu64
6102026-05-21T17:29:38.848ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 34 table_name = measurements_histogramu64
6112026-05-21T17:29:38.850ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 50 table_name = measurements_u64
6122026-05-21T17:29:38.930ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
6132026-05-21T17:29:39.226ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
6142026-05-21T17:29:39.226ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?sort_by=id_ascending
6152026-05-21T17:29:39.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6162026-05-21T17:29:39.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6172026-05-21T17:29:39.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6182026-05-21T17:29:39.249ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6192026-05-21T17:29:39.249ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = abfc807c-8485-4e2a-b1a5-e30ecd4f3926 producer_ip = fd00:1122:3344:101::1 producer_port = 45398
6202026-05-21T17:29:39.249ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = abfc807c-8485-4e2a-b1a5-e30ecd4f3926 producer_ip = fd00:1122:3344:101::1 producer_port = 45398
6212026-05-21T17:29:39.249ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = abfc807c-8485-4e2a-b1a5-e30ecd4f3926 producer_ip = fd00:1122:3344:101::1 producer_port = 45398
6222026-05-21T17:29:39.249ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "da501806-4a9c-427e-a70c-c0243a477e18", "content-length": "1276", "date": "Thu, 21 May 2026 17:29:39 GMT"} })
6232026-05-21T17:29:39.249ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYmZjODA3Yy04NDg1LTRlMmEtYjFhNS1lMzBlY2Q0ZjM5MjYifX0%3D
6242026-05-21T17:29:39.255ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYmZjODA3Yy04NDg1LTRlMmEtYjFhNS1lMzBlY2Q0ZjM5MjYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6cee57a-2b43-44a1-b8a5-8e69f8caba77", "content-length": "29", "date": "Thu, 21 May 2026 17:29:39 GMT"} })
6252026-05-21T17:29:39.255ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:58159 collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 51e68294-d94a-4054-b8d8-62ce4a985f97
6262026-05-21T17:29:39.255ZDEBGoximeter (oximeter-agent): received request to register existing metric producer, updating collection information address = [fd00:1122:3344:101::2]:36874 collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = 5be102f7-8320-4ece-b241-c1828c196ac4
6272026-05-21T17:29:39.255ZDEBGoximeter (collection-task-handle): notified collection task of new producer endpoint collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 5be102f7-8320-4ece-b241-c1828c196ac4 producer_ip = fd00:1122:3344:101::2 producer_port = 59932
6282026-05-21T17:29:39.255ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:61603 collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 70795b77-37cd-4507-8781-f972334cb32a
6292026-05-21T17:29:39.255ZDEBGoximeter (collection-task): collection task received request to update its producer information address = [fd00:1122:3344:101::2]:36874 collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = 5be102f7-8320-4ece-b241-c1828c196ac4 producer_ip = fd00:1122:3344:101::2 producer_port = 59932
6302026-05-21T17:29:39.255ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 8 n_pruned_tasks = 0
6312026-05-21T17:29:39.257ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 70795b77-37cd-4507-8781-f972334cb32a producer_ip = fd00:1122:3344:101::b producer_port = 61603
6322026-05-21T17:29:39.257ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 51e68294-d94a-4054-b8d8-62ce4a985f97 producer_ip = fd00:1122:3344:101::a producer_port = 58159
6332026-05-21T17:29:39.257ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 51e68294-d94a-4054-b8d8-62ce4a985f97 producer_ip = fd00:1122:3344:101::a producer_port = 58159
6342026-05-21T17:29:39.257ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 5be102f7-8320-4ece-b241-c1828c196ac4 producer_ip = fd00:1122:3344:101::2 producer_port = 59932
6352026-05-21T17:29:39.257ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 51e68294-d94a-4054-b8d8-62ce4a985f97 producer_ip = fd00:1122:3344:101::a producer_port = 58159
6362026-05-21T17:29:39.257ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 5be102f7-8320-4ece-b241-c1828c196ac4 producer_ip = fd00:1122:3344:101::2 producer_port = 59932
6372026-05-21T17:29:39.257ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 70795b77-37cd-4507-8781-f972334cb32a producer_ip = fd00:1122:3344:101::b producer_port = 61603
6382026-05-21T17:29:39.257ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 70795b77-37cd-4507-8781-f972334cb32a producer_ip = fd00:1122:3344:101::b producer_port = 61603
6392026-05-21T17:29:39.265ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = 70795b77-37cd-4507-8781-f972334cb32a producer_ip = fd00:1122:3344:101::b producer_port = 61603
6402026-05-21T17:29:39.277ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 6 producer_id = 51e68294-d94a-4054-b8d8-62ce4a985f97 producer_ip = fd00:1122:3344:101::a producer_port = 58159
6412026-05-21T17:29:39.281ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 142 producer_id = 5be102f7-8320-4ece-b241-c1828c196ac4 producer_ip = fd00:1122:3344:101::2 producer_port = 59932
6422026-05-21T17:29:39.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6432026-05-21T17:29:39.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6442026-05-21T17:29:39.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6452026-05-21T17:29:39.315ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 1473 producer_id = abfc807c-8485-4e2a-b1a5-e30ecd4f3926 producer_ip = fd00:1122:3344:101::1 producer_port = 45398
6462026-05-21T17:29:39.320ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 1668
6472026-05-21T17:29:39.321ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 1668
6482026-05-21T17:29:39.321ZDEBGoximeter (clickhouse-client): unrolling 1668 total samples collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
6492026-05-21T17:29:39.368ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
6502026-05-21T17:29:39.372ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("database_transaction:retry_data"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "attempt", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:29:39.322791044Z } timeseries_name = database_transaction:retry_data
6512026-05-21T17:29:39.372ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:29:39.327206383Z } timeseries_name = dendrite:sample_collection_duration
6522026-05-21T17:29:39.372ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:29:39.323017338Z } timeseries_name = switch_data_link:link_enabled
6532026-05-21T17:29:39.372ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:29:39.323080009Z } timeseries_name = switch_data_link:link_up
6542026-05-21T17:29:39.372ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:29:39.323250772Z } timeseries_name = switch_table:capacity
6552026-05-21T17:29:39.372ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:29:39.323542777Z } timeseries_name = switch_table:collisions
6562026-05-21T17:29:39.372ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:29:39.323662609Z } timeseries_name = switch_table:delete_misses
6572026-05-21T17:29:39.372ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:29:39.323427095Z } timeseries_name = switch_table:deletes
6582026-05-21T17:29:39.372ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:29:39.323722100Z } timeseries_name = switch_table:exhaustion
6592026-05-21T17:29:39.372ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:29:39.323368014Z } timeseries_name = switch_table:inserts
6602026-05-21T17:29:39.372ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:29:39.323309363Z } timeseries_name = switch_table:occupancy
6612026-05-21T17:29:39.372ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:29:39.323602018Z } timeseries_name = switch_table:update_misses
6622026-05-21T17:29:39.372ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:29:39.323485106Z } timeseries_name = switch_table:updates
6632026-05-21T17:29:39.385ZDEBGoximeter (clickhouse-client): inserting 13 new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
6642026-05-21T17:29:39.389ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 284 table_name = fields_i16
6652026-05-21T17:29:39.390ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 8 table_name = fields_ipaddr
6662026-05-21T17:29:39.394ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 3159 table_name = fields_string
6672026-05-21T17:29:39.395ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 167 table_name = fields_u16
6682026-05-21T17:29:39.397ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 951 table_name = fields_u32
6692026-05-21T17:29:39.398ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 1 table_name = fields_u64
6702026-05-21T17:29:39.399ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 148 table_name = fields_u8
6712026-05-21T17:29:39.401ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 1722 table_name = fields_uuid
6722026-05-21T17:29:39.403ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 6 table_name = measurements_bool
6732026-05-21T17:29:39.405ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 1603 table_name = measurements_cumulativeu64
6742026-05-21T17:29:39.409ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 2 table_name = measurements_f64
6752026-05-21T17:29:39.411ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 17 table_name = measurements_histogramu64
6762026-05-21T17:29:39.413ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 40 table_name = measurements_u64
6772026-05-21T17:29:39.421ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
6782026-05-21T17:29:40.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6792026-05-21T17:29:40.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6802026-05-21T17:29:40.235ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6812026-05-21T17:29:40.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6822026-05-21T17:29:40.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6832026-05-21T17:29:40.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6842026-05-21T17:29:41.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6852026-05-21T17:29:41.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6862026-05-21T17:29:41.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6872026-05-21T17:29:41.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6882026-05-21T17:29:41.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6892026-05-21T17:29:41.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6902026-05-21T17:29:42.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6912026-05-21T17:29:42.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6922026-05-21T17:29:42.235ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6932026-05-21T17:29:42.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6942026-05-21T17:29:42.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6952026-05-21T17:29:42.287ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6962026-05-21T17:29:43.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6972026-05-21T17:29:43.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6982026-05-21T17:29:43.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6992026-05-21T17:29:43.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7002026-05-21T17:29:43.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7012026-05-21T17:29:43.287ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7022026-05-21T17:29:43.829ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 160
7032026-05-21T17:29:43.829ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 160
7042026-05-21T17:29:43.829ZDEBGoximeter (clickhouse-client): unrolling 160 total samples collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
7052026-05-21T17:29:43.834ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
7062026-05-21T17:29:43.840ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 52 table_name = fields_string
7072026-05-21T17:29:43.841ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 56 table_name = fields_uuid
7082026-05-21T17:29:43.843ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 120 table_name = measurements_cumulativeu64
7092026-05-21T17:29:43.845ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 40 table_name = measurements_u64
7102026-05-21T17:29:43.930ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
7112026-05-21T17:29:44.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7122026-05-21T17:29:44.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82 producer_ip = fd00:1122:3344:101::c producer_port = 51333
7132026-05-21T17:29:44.231ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7142026-05-21T17:29:44.231ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82 producer_ip = fd00:1122:3344:101::c producer_port = 51333
7152026-05-21T17:29:44.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = a723d9dc-00e6-4234-b03d-315f8903a755 producer_ip = fd00:1122:3344:101::2 producer_port = 58573
7162026-05-21T17:29:44.231ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = a723d9dc-00e6-4234-b03d-315f8903a755 producer_ip = fd00:1122:3344:101::2 producer_port = 58573
7172026-05-21T17:29:44.233ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = a723d9dc-00e6-4234-b03d-315f8903a755 producer_ip = fd00:1122:3344:101::2 producer_port = 58573
7182026-05-21T17:29:44.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7192026-05-21T17:29:44.235ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82 producer_ip = fd00:1122:3344:101::c producer_port = 51333
7202026-05-21T17:29:44.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7212026-05-21T17:29:44.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7222026-05-21T17:29:44.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7232026-05-21T17:29:45.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7242026-05-21T17:29:45.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7252026-05-21T17:29:45.235ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7262026-05-21T17:29:45.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7272026-05-21T17:29:45.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7282026-05-21T17:29:45.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7292026-05-21T17:29:46.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7302026-05-21T17:29:46.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7312026-05-21T17:29:46.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7322026-05-21T17:29:46.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7332026-05-21T17:29:46.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7342026-05-21T17:29:46.287ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7352026-05-21T17:29:47.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7362026-05-21T17:29:47.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7372026-05-21T17:29:47.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7382026-05-21T17:29:47.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7392026-05-21T17:29:47.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7402026-05-21T17:29:47.287ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7412026-05-21T17:29:48.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7422026-05-21T17:29:48.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7432026-05-21T17:29:48.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7442026-05-21T17:29:48.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7452026-05-21T17:29:48.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7462026-05-21T17:29:48.287ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7472026-05-21T17:29:48.829ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 234
7482026-05-21T17:29:48.829ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 234
7492026-05-21T17:29:48.829ZDEBGoximeter (clickhouse-client): unrolling 234 total samples collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
7502026-05-21T17:29:48.836ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
7512026-05-21T17:29:48.844ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 120 table_name = fields_string
7522026-05-21T17:29:48.845ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 34 table_name = fields_u16
7532026-05-21T17:29:48.847ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 90 table_name = fields_uuid
7542026-05-21T17:29:48.848ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 150 table_name = measurements_cumulativeu64
7552026-05-21T17:29:48.850ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 34 table_name = measurements_histogramu64
7562026-05-21T17:29:48.852ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 50 table_name = measurements_u64
7572026-05-21T17:29:48.930ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
7582026-05-21T17:29:49.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7592026-05-21T17:29:49.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7602026-05-21T17:29:49.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7612026-05-21T17:29:49.256ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 70795b77-37cd-4507-8781-f972334cb32a producer_ip = fd00:1122:3344:101::b producer_port = 61603
7622026-05-21T17:29:49.256ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 70795b77-37cd-4507-8781-f972334cb32a producer_ip = fd00:1122:3344:101::b producer_port = 61603
7632026-05-21T17:29:49.256ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 5be102f7-8320-4ece-b241-c1828c196ac4 producer_ip = fd00:1122:3344:101::2 producer_port = 59932
7642026-05-21T17:29:49.256ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 5be102f7-8320-4ece-b241-c1828c196ac4 producer_ip = fd00:1122:3344:101::2 producer_port = 59932
7652026-05-21T17:29:49.256ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 51e68294-d94a-4054-b8d8-62ce4a985f97 producer_ip = fd00:1122:3344:101::a producer_port = 58159
7662026-05-21T17:29:49.256ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 51e68294-d94a-4054-b8d8-62ce4a985f97 producer_ip = fd00:1122:3344:101::a producer_port = 58159
7672026-05-21T17:29:49.257ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 70795b77-37cd-4507-8781-f972334cb32a producer_ip = fd00:1122:3344:101::b producer_port = 61603
7682026-05-21T17:29:49.258ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 6 producer_id = 51e68294-d94a-4054-b8d8-62ce4a985f97 producer_ip = fd00:1122:3344:101::a producer_port = 58159
7692026-05-21T17:29:49.270ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 142 producer_id = 5be102f7-8320-4ece-b241-c1828c196ac4 producer_ip = fd00:1122:3344:101::2 producer_port = 59932
7702026-05-21T17:29:49.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7712026-05-21T17:29:49.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7722026-05-21T17:29:49.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7732026-05-21T17:29:50.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7742026-05-21T17:29:50.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7752026-05-21T17:29:50.235ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7762026-05-21T17:29:50.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7772026-05-21T17:29:50.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7782026-05-21T17:29:50.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7792026-05-21T17:29:51.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7802026-05-21T17:29:51.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7812026-05-21T17:29:51.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7822026-05-21T17:29:51.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7832026-05-21T17:29:51.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7842026-05-21T17:29:51.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7852026-05-21T17:29:52.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7862026-05-21T17:29:52.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7872026-05-21T17:29:52.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7882026-05-21T17:29:52.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7892026-05-21T17:29:52.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7902026-05-21T17:29:52.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7912026-05-21T17:29:53.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7922026-05-21T17:29:53.231ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7932026-05-21T17:29:53.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7942026-05-21T17:29:53.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7952026-05-21T17:29:53.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7962026-05-21T17:29:53.287ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7972026-05-21T17:29:53.829ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 350
7982026-05-21T17:29:53.829ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 350
7992026-05-21T17:29:53.829ZDEBGoximeter (clickhouse-client): unrolling 350 total samples collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
8002026-05-21T17:29:53.840ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
8012026-05-21T17:29:53.853ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 284 table_name = fields_i16
8022026-05-21T17:29:53.855ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 809 table_name = fields_string
8032026-05-21T17:29:53.856ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 150 table_name = fields_u16
8042026-05-21T17:29:53.857ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 149 table_name = fields_u32
8052026-05-21T17:29:53.859ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 148 table_name = fields_u8
8062026-05-21T17:29:53.860ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 490 table_name = fields_uuid
8072026-05-21T17:29:53.862ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 6 table_name = measurements_bool
8082026-05-21T17:29:53.863ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 255 table_name = measurements_cumulativeu64
8092026-05-21T17:29:53.864ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 1 table_name = measurements_f64
8102026-05-21T17:29:53.866ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 8 table_name = measurements_histogramu64
8112026-05-21T17:29:53.867ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 80 table_name = measurements_u64
8122026-05-21T17:29:53.930ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
8132026-05-21T17:29:54.226ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
8142026-05-21T17:29:54.226ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?sort_by=id_ascending
8152026-05-21T17:29:54.229ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b2abd5a-a50a-4300-b69c-edbdb58687bb", "content-length": "1412", "date": "Thu, 21 May 2026 17:29:54 GMT"} })
8162026-05-21T17:29:54.229ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYmZjODA3Yy04NDg1LTRlMmEtYjFhNS1lMzBlY2Q0ZjM5MjYifX0%3D
8172026-05-21T17:29:54.231ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = a723d9dc-00e6-4234-b03d-315f8903a755 producer_ip = fd00:1122:3344:101::2 producer_port = 58573
8182026-05-21T17:29:54.231ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82 producer_ip = fd00:1122:3344:101::c producer_port = 51333
8192026-05-21T17:29:54.231ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = a723d9dc-00e6-4234-b03d-315f8903a755 producer_ip = fd00:1122:3344:101::2 producer_port = 58573
8202026-05-21T17:29:54.231ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8212026-05-21T17:29:54.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82 producer_ip = fd00:1122:3344:101::c producer_port = 51333
8222026-05-21T17:29:54.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82 producer_ip = fd00:1122:3344:101::c producer_port = 51333
8232026-05-21T17:29:54.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8242026-05-21T17:29:54.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8252026-05-21T17:29:54.232ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/5a4bd7f7-44d9-49f9-96e0-999e9548e3e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhYmZjODA3Yy04NDg1LTRlMmEtYjFhNS1lMzBlY2Q0ZjM5MjYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "05ee1c23-b806-460b-8691-c1c9b686036c", "content-length": "29", "date": "Thu, 21 May 2026 17:29:54 GMT"} })
8262026-05-21T17:29:54.232ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67
8272026-05-21T17:29:54.232ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 9 n_pruned_tasks = 0
8282026-05-21T17:29:54.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8292026-05-21T17:29:54.232ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8302026-05-21T17:29:54.233ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8312026-05-21T17:29:54.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = a723d9dc-00e6-4234-b03d-315f8903a755 producer_ip = fd00:1122:3344:101::2 producer_port = 58573
8322026-05-21T17:29:54.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8332026-05-21T17:29:54.235ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 4293e544-786a-4af2-b3a6-5728a59a8e82 producer_ip = fd00:1122:3344:101::c producer_port = 51333
8342026-05-21T17:29:54.240ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8352026-05-21T17:29:54.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8362026-05-21T17:29:54.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8372026-05-21T17:29:54.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8382026-05-21T17:29:55.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8392026-05-21T17:29:55.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8402026-05-21T17:29:55.233ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8412026-05-21T17:29:55.233ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8422026-05-21T17:29:55.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8432026-05-21T17:29:55.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8442026-05-21T17:29:55.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8452026-05-21T17:29:55.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8462026-05-21T17:29:55.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8472026-05-21T17:29:56.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8482026-05-21T17:29:56.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8492026-05-21T17:29:56.233ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8502026-05-21T17:29:56.233ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8512026-05-21T17:29:56.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8522026-05-21T17:29:56.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8532026-05-21T17:29:56.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8542026-05-21T17:29:56.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8552026-05-21T17:29:56.287ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8562026-05-21T17:29:57.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8572026-05-21T17:29:57.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8582026-05-21T17:29:57.233ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8592026-05-21T17:29:57.233ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8602026-05-21T17:29:57.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8612026-05-21T17:29:57.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8622026-05-21T17:29:57.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8632026-05-21T17:29:57.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8642026-05-21T17:29:57.287ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8652026-05-21T17:29:58.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8662026-05-21T17:29:58.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8672026-05-21T17:29:58.233ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8682026-05-21T17:29:58.233ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8692026-05-21T17:29:58.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8702026-05-21T17:29:58.235ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8712026-05-21T17:29:58.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8722026-05-21T17:29:58.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8732026-05-21T17:29:58.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8742026-05-21T17:29:58.829ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 257
8752026-05-21T17:29:58.829ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_samples = 257
8762026-05-21T17:29:58.829ZDEBGoximeter (clickhouse-client): unrolling 257 total samples collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
8772026-05-21T17:29:58.837ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
8782026-05-21T17:29:58.841ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:29:58.831847641Z } timeseries_name = mg_lower:routes_blocked_by_link_state
8792026-05-21T17:29:58.841ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:29:58.831735789Z } timeseries_name = static_routing_config:static_nexthops
8802026-05-21T17:29:58.841ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:29:58.831679308Z } timeseries_name = static_routing_config:static_routes
8812026-05-21T17:29:58.841ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T17:29:58.831791750Z } timeseries_name = switch_rib:active_routes
8822026-05-21T17:29:58.842ZDEBGoximeter (clickhouse-client): inserting 4 new timeseries schema collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60
8832026-05-21T17:29:58.845ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 6 table_name = fields_ipaddr
8842026-05-21T17:29:58.847ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 127 table_name = fields_string
8852026-05-21T17:29:58.848ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 40 table_name = fields_u16
8862026-05-21T17:29:58.850ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 104 table_name = fields_uuid
8872026-05-21T17:29:58.851ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 163 table_name = measurements_cumulativeu64
8882026-05-21T17:29:58.853ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 34 table_name = measurements_histogramu64
8892026-05-21T17:29:58.854ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d id = 97c7c30b-6c4f-426b-8435-b61dbc3a4a60 n_rows = 60 table_name = measurements_u64
8902026-05-21T17:29:58.930ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
8912026-05-21T17:29:59.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8922026-05-21T17:29:59.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8932026-05-21T17:29:59.233ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8942026-05-21T17:29:59.233ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8952026-05-21T17:29:59.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8962026-05-21T17:29:59.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8972026-05-21T17:29:59.257ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 51e68294-d94a-4054-b8d8-62ce4a985f97 producer_ip = fd00:1122:3344:101::a producer_port = 58159
8982026-05-21T17:29:59.257ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 51e68294-d94a-4054-b8d8-62ce4a985f97 producer_ip = fd00:1122:3344:101::a producer_port = 58159
8992026-05-21T17:29:59.257ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 70795b77-37cd-4507-8781-f972334cb32a producer_ip = fd00:1122:3344:101::b producer_port = 61603
9002026-05-21T17:29:59.257ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 5be102f7-8320-4ece-b241-c1828c196ac4 producer_ip = fd00:1122:3344:101::2 producer_port = 59932
9012026-05-21T17:29:59.257ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 5be102f7-8320-4ece-b241-c1828c196ac4 producer_ip = fd00:1122:3344:101::2 producer_port = 59932
9022026-05-21T17:29:59.257ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 70795b77-37cd-4507-8781-f972334cb32a producer_ip = fd00:1122:3344:101::b producer_port = 61603
9032026-05-21T17:29:59.258ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 70795b77-37cd-4507-8781-f972334cb32a producer_ip = fd00:1122:3344:101::b producer_port = 61603
9042026-05-21T17:29:59.259ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 6 producer_id = 51e68294-d94a-4054-b8d8-62ce4a985f97 producer_ip = fd00:1122:3344:101::a producer_port = 58159
9052026-05-21T17:29:59.270ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 142 producer_id = 5be102f7-8320-4ece-b241-c1828c196ac4 producer_ip = fd00:1122:3344:101::2 producer_port = 59932
9062026-05-21T17:29:59.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9072026-05-21T17:29:59.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9082026-05-21T17:29:59.287ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9092026-05-21T17:30:00.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9102026-05-21T17:30:00.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9112026-05-21T17:30:00.233ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9122026-05-21T17:30:00.233ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9132026-05-21T17:30:00.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9142026-05-21T17:30:00.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9152026-05-21T17:30:00.284ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9162026-05-21T17:30:00.284ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9172026-05-21T17:30:00.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9182026-05-21T17:30:01.232ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9192026-05-21T17:30:01.232ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9202026-05-21T17:30:01.233ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9212026-05-21T17:30:01.233ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9222026-05-21T17:30:01.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 160234f1-2ef3-475c-bfa9-098c4dbb1d67 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9232026-05-21T17:30:01.235ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 9ee30242-a128-47ef-9ba3-02ad88ecdf63 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9242026-05-21T17:30:01.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9252026-05-21T17:30:01.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9262026-05-21T17:30:01.287ZDEBGoximeter (collection-task): collected results from producer collector_id = 5a4bd7f7-44d9-49f9-96e0-999e9548e3e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 7c928450-c5e5-4458-93c2-7466de4b65ba producer_ip = fd00:1122:3344:101::2 producer_port = 8001