Max level shown:
1 [ May 21 22:28:00 Enabled. ]
2 [ May 21 22:28:00 Rereading configuration. ]
3 [ May 21 22:28:02 Rereading configuration. ]
4 [ May 21 22:28:06 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id 3766df1f-59e2-4938-93ac-1372dbbc9e67 &"). ]
5 [ May 21 22:28:06 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-05-21T22:28:06.204ZDEBGoximeter: registered DTrace probes
82026-05-21T22:28:06.205ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:301
92026-05-21T22:28:06.205ZDEBGoximeter: creating ClickHouse client
102026-05-21T22:28:06.226ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
112026-05-21T22:28:10.836ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:890 id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
122026-05-21T22:28:10.836ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d
132026-05-21T22:28:10.836ZINFOoximeter (clickhouse-client): reading db version collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:790 id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
142026-05-21T22:28:10.838ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:890 id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
152026-05-21T22:28:10.838ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:795 id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 version = 0
162026-05-21T22:28:10.838ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:800 id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
172026-05-21T22:28:10.838ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
182026-05-21T22:28:10.932ZINFOoximeter (clickhouse-client): inserting current version collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:821 id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 version = 14
192026-05-21T22:28:10.952ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = 8045d230-d253-4646-9da5-dfd7093394eb
202026-05-21T22:28:10.958ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-05-21T22:28:10.958ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-05-21T22:28:10.958ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-05-21T22:28:10.958ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-05-21T22:28:10.958ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.0/src/server.rs:335 local_addr = [fd00:1122:3344:101::d]:12223
252026-05-21T22:28:10.962ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-05-21T22:28:10.962ZDEBGoximeter: registered USDT probes
272026-05-21T22:28:10.962ZDEBGoximeter: contacting nexus
282026-05-21T22:28:10.978ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
292026-05-21T22:28:10.979ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
302026-05-21T22:28:10.979ZWARNoximeter: failed to contact nexus, will retry in 230.786221ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:446
312026-05-21T22:28:11.212ZDEBGoximeter: contacting nexus
322026-05-21T22:28:11.212ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
332026-05-21T22:28:11.212ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
342026-05-21T22:28:11.212ZWARNoximeter: failed to contact nexus, will retry in 591.0013ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:446
352026-05-21T22:28:11.804ZDEBGoximeter: contacting nexus
362026-05-21T22:28:11.804ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
372026-05-21T22:28:11.804ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
382026-05-21T22:28:11.804ZWARNoximeter: failed to contact nexus, will retry in 1.258548545s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:446
392026-05-21T22:28:13.065ZDEBGoximeter: contacting nexus
402026-05-21T22:28:13.065ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
412026-05-21T22:28:13.120ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "70966213-cec6-4428-b129-1f150c439db4", "date": "Thu, 21 May 2026 22:28:13 GMT"} })
422026-05-21T22:28:13.120ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:464 id = 3766df1f-59e2-4938-93ac-1372dbbc9e67
432026-05-21T22:28:13.120ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
442026-05-21T22:28:13.121ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
452026-05-21T22:28:13.123ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?sort_by=id_ascending
462026-05-21T22:28:13.155ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d61e04e-07e2-404f-9c21-32277eeecce6", "content-length": "29", "date": "Thu, 21 May 2026 22:28:13 GMT"} })
472026-05-21T22:28:13.155ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 0 n_pruned_tasks = 0
482026-05-21T22:28:15.952ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d
492026-05-21T22:28:15.953ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d
502026-05-21T22:28:20.952ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d
512026-05-21T22:28:20.953ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d
522026-05-21T22:28:25.952ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d
532026-05-21T22:28:25.953ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d
542026-05-21T22:28:28.121ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
552026-05-21T22:28:28.121ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?sort_by=id_ascending
562026-05-21T22:28:28.136ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "15ce8ea2-cea9-4fb9-ac68-9bf2a37eec75", "content-length": "300", "date": "Thu, 21 May 2026 22:28:28 GMT"} })
572026-05-21T22:28:28.138ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiIwNTQ3NmFhNy0xZDRmLTQ0OTYtYWZmOS0xODU2NzlkZmFiYzUifX0%3D
582026-05-21T22:28:28.141ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiIwNTQ3NmFhNy0xZDRmLTQ0OTYtYWZmOS0xODU2NzlkZmFiYzUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "875dfc09-5a91-4d9f-9fcc-74cca2957c18", "content-length": "29", "date": "Thu, 21 May 2026 22:28:28 GMT"} })
592026-05-21T22:28:28.141ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:60682 collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5
602026-05-21T22:28:28.141ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 1 n_pruned_tasks = 0
612026-05-21T22:28:28.142ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
622026-05-21T22:28:28.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
632026-05-21T22:28:28.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
642026-05-21T22:28:28.180ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 24 producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
652026-05-21T22:28:30.952ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 25
662026-05-21T22:28:30.952ZDEBGoximeter (clickhouse-client): unrolling 25 total samples collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
672026-05-21T22:28:30.955ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 25
682026-05-21T22:28:30.961ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
692026-05-21T22:28:30.974ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:30.958624849Z } timeseries_name = collection_target:cpus_provisioned
702026-05-21T22:28:30.974ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:30.958684571Z } timeseries_name = collection_target:ram_provisioned
712026-05-21T22:28:30.974ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:30.958744063Z } timeseries_name = collection_target:virtual_disk_space_provisioned
722026-05-21T22:28:30.974ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:30.955571984Z } timeseries_name = http_service:request_latency_histogram
732026-05-21T22:28:30.974ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:30.955428730Z } timeseries_name = oximeter_collector:collections
742026-05-21T22:28:30.979ZDEBGoximeter (clickhouse-client): inserting 5 new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
752026-05-21T22:28:30.993ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 2 table_name = fields_ipaddr
762026-05-21T22:28:30.998ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 25 table_name = fields_string
772026-05-21T22:28:31.000ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 14 table_name = fields_u16
782026-05-21T22:28:31.001ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 26 table_name = fields_uuid
792026-05-21T22:28:31.003ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 1 table_name = measurements_cumulativeu64
802026-05-21T22:28:31.008ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 12 table_name = measurements_histogramu64
812026-05-21T22:28:31.010ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 12 table_name = measurements_i64
822026-05-21T22:28:31.058ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
832026-05-21T22:28:35.952ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d
842026-05-21T22:28:35.953ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d
852026-05-21T22:28:38.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
862026-05-21T22:28:38.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
872026-05-21T22:28:38.176ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 38 producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
882026-05-21T22:28:40.951ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 38
892026-05-21T22:28:40.951ZDEBGoximeter (clickhouse-client): unrolling 38 total samples collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
902026-05-21T22:28:40.952ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 38
912026-05-21T22:28:40.953ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
922026-05-21T22:28:40.986ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 52 table_name = fields_string
932026-05-21T22:28:40.988ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 26 table_name = fields_u16
942026-05-21T22:28:40.990ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 32 table_name = fields_uuid
952026-05-21T22:28:40.993ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 26 table_name = measurements_histogramu64
962026-05-21T22:28:40.998ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 12 table_name = measurements_i64
972026-05-21T22:28:41.054ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
982026-05-21T22:28:43.121ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
992026-05-21T22:28:43.121ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?sort_by=id_ascending
1002026-05-21T22:28:43.143ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "e653f092-ba0f-4e9c-af53-3f890a24cf30", "content-length": "574", "date": "Thu, 21 May 2026 22:28:43 GMT"} })
1012026-05-21T22:28:43.143ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI2NDk5NzgzYi1kOWRmLTQ1MGUtYjQ0OC02ZGUwMjA5ZmFlODEifX0%3D
1022026-05-21T22:28:43.146ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI2NDk5NzgzYi1kOWRmLTQ1MGUtYjQ0OC02ZGUwMjA5ZmFlODEifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "47bbb7e9-8216-4065-8eac-0cee31818e34", "content-length": "29", "date": "Thu, 21 May 2026 22:28:43 GMT"} })
1032026-05-21T22:28:43.146ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97
1042026-05-21T22:28:43.146ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:39922 collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 6499783b-d9df-450e-b448-6de0209fae81
1052026-05-21T22:28:43.146ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 3 n_pruned_tasks = 0
1062026-05-21T22:28:43.147ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 6499783b-d9df-450e-b448-6de0209fae81 producer_ip = fd00:1122:3344:101::2 producer_port = 39922
1072026-05-21T22:28:43.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1082026-05-21T22:28:43.147ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1092026-05-21T22:28:43.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 6499783b-d9df-450e-b448-6de0209fae81 producer_ip = fd00:1122:3344:101::2 producer_port = 39922
1102026-05-21T22:28:43.148ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1112026-05-21T22:28:43.148ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 6499783b-d9df-450e-b448-6de0209fae81 producer_ip = fd00:1122:3344:101::2 producer_port = 39922
1122026-05-21T22:28:43.152ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1132026-05-21T22:28:43.184ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 276 producer_id = 6499783b-d9df-450e-b448-6de0209fae81 producer_ip = fd00:1122:3344:101::2 producer_port = 39922
1142026-05-21T22:28:44.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1152026-05-21T22:28:44.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1162026-05-21T22:28:44.150ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1172026-05-21T22:28:45.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1182026-05-21T22:28:45.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1192026-05-21T22:28:45.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1202026-05-21T22:28:45.951ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 356
1212026-05-21T22:28:45.951ZDEBGoximeter (clickhouse-client): unrolling 356 total samples collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
1222026-05-21T22:28:45.952ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 356
1232026-05-21T22:28:45.967ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
1242026-05-21T22:28:45.971ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:45.952359627Z } timeseries_name = ddm_router:originated_tunnel_endpoints
1252026-05-21T22:28:45.971ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:45.952266655Z } timeseries_name = ddm_router:originated_underlay_prefixes
1262026-05-21T22:28:45.971ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:45.952721927Z } timeseries_name = ddm_session:advertisements_received
1272026-05-21T22:28:45.972ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:45.952632415Z } timeseries_name = ddm_session:advertisements_sent
1282026-05-21T22:28:45.972ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:45.953421237Z } timeseries_name = ddm_session:imported_tunnel_endpoints
1292026-05-21T22:28:45.972ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:45.953337305Z } timeseries_name = ddm_session:imported_underlay_prefixes
1302026-05-21T22:28:45.972ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:45.952906542Z } timeseries_name = ddm_session:peer_address_changes
1312026-05-21T22:28:45.972ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:45.952811070Z } timeseries_name = ddm_session:peer_expirations
1322026-05-21T22:28:45.972ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:45.952993415Z } timeseries_name = ddm_session:peer_sessions_established
1332026-05-21T22:28:45.972ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:45.952542812Z } timeseries_name = ddm_session:solicitations_received
1342026-05-21T22:28:45.972ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:45.952451980Z } timeseries_name = ddm_session:solicitations_sent
1352026-05-21T22:28:45.972ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:45.953257762Z } timeseries_name = ddm_session:update_send_fail
1362026-05-21T22:28:45.972ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:45.953167770Z } timeseries_name = ddm_session:updates_received
1372026-05-21T22:28:45.972ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:45.953076647Z } timeseries_name = ddm_session:updates_sent
1382026-05-21T22:28:45.972ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:45.954153357Z } timeseries_name = switch_port_control_data_link:bytes_received
1392026-05-21T22:28:45.972ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:45.954319692Z } timeseries_name = switch_port_control_data_link:bytes_sent
1402026-05-21T22:28:45.972ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:45.953983903Z } timeseries_name = switch_port_control_data_link:errors_received
1412026-05-21T22:28:45.972ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:45.954068515Z } timeseries_name = switch_port_control_data_link:errors_sent
1422026-05-21T22:28:45.972ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:45.954238560Z } timeseries_name = switch_port_control_data_link:packets_received
1432026-05-21T22:28:45.972ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:28:45.954418525Z } timeseries_name = switch_port_control_data_link:packets_sent
1442026-05-21T22:28:45.976ZDEBGoximeter (clickhouse-client): inserting 20 new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
1452026-05-21T22:28:45.981ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 24 table_name = fields_i16
1462026-05-21T22:28:45.983ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 4 table_name = fields_ipaddr
1472026-05-21T22:28:45.985ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 148 table_name = fields_string
1482026-05-21T22:28:45.987ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 16 table_name = fields_u16
1492026-05-21T22:28:45.989ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 24 table_name = fields_u32
1502026-05-21T22:28:45.991ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 12 table_name = fields_u8
1512026-05-21T22:28:45.993ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 68 table_name = fields_uuid
1522026-05-21T22:28:45.995ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 338 table_name = measurements_cumulativeu64
1532026-05-21T22:28:45.997ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 18 table_name = measurements_u64
1542026-05-21T22:28:46.053ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
1552026-05-21T22:28:46.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1562026-05-21T22:28:46.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1572026-05-21T22:28:46.150ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1582026-05-21T22:28:47.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1592026-05-21T22:28:47.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1602026-05-21T22:28:47.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1612026-05-21T22:28:48.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1622026-05-21T22:28:48.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1632026-05-21T22:28:48.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1642026-05-21T22:28:48.172ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
1652026-05-21T22:28:48.172ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
1662026-05-21T22:28:48.176ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 26 producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
1672026-05-21T22:28:49.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1682026-05-21T22:28:49.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1692026-05-21T22:28:49.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1702026-05-21T22:28:50.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1712026-05-21T22:28:50.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1722026-05-21T22:28:50.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1732026-05-21T22:28:50.953ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 156
1742026-05-21T22:28:50.953ZDEBGoximeter (clickhouse-client): unrolling 156 total samples collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
1752026-05-21T22:28:50.953ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 156
1762026-05-21T22:28:50.958ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
1772026-05-21T22:28:50.969ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 78 table_name = fields_string
1782026-05-21T22:28:50.970ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 26 table_name = fields_u16
1792026-05-21T22:28:50.972ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 54 table_name = fields_uuid
1802026-05-21T22:28:50.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 100 table_name = measurements_cumulativeu64
1812026-05-21T22:28:50.975ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 26 table_name = measurements_histogramu64
1822026-05-21T22:28:50.977ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 30 table_name = measurements_u64
1832026-05-21T22:28:51.054ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
1842026-05-21T22:28:51.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1852026-05-21T22:28:51.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1862026-05-21T22:28:51.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1872026-05-21T22:28:52.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1882026-05-21T22:28:52.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1892026-05-21T22:28:52.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1902026-05-21T22:28:53.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1912026-05-21T22:28:53.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1922026-05-21T22:28:53.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1932026-05-21T22:28:54.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1942026-05-21T22:28:54.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1952026-05-21T22:28:54.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1962026-05-21T22:28:55.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1972026-05-21T22:28:55.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1982026-05-21T22:28:55.148ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1992026-05-21T22:28:55.952ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 130
2002026-05-21T22:28:55.952ZDEBGoximeter (clickhouse-client): unrolling 130 total samples collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
2012026-05-21T22:28:55.953ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 130
2022026-05-21T22:28:55.956ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
2032026-05-21T22:28:55.962ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 26 table_name = fields_string
2042026-05-21T22:28:55.964ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 28 table_name = fields_uuid
2052026-05-21T22:28:55.965ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 100 table_name = measurements_cumulativeu64
2062026-05-21T22:28:55.967ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 30 table_name = measurements_u64
2072026-05-21T22:28:56.054ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
2082026-05-21T22:28:56.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2092026-05-21T22:28:56.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2102026-05-21T22:28:56.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2112026-05-21T22:28:57.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2122026-05-21T22:28:57.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2132026-05-21T22:28:57.150ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2142026-05-21T22:28:58.121ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
2152026-05-21T22:28:58.121ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?sort_by=id_ascending
2162026-05-21T22:28:58.126ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "e65a31f1-b687-48a4-92f1-55ac2f8b5782", "content-length": "710", "date": "Thu, 21 May 2026 22:28:58 GMT"} })
2172026-05-21T22:28:58.126ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI5YTdjMzgzYy1mYjE3LTQwNmUtYjQ2YS1jYzU5M2ZiNTZhZDcifX0%3D
2182026-05-21T22:28:58.129ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI5YTdjMzgzYy1mYjE3LTQwNmUtYjQ2YS1jYzU5M2ZiNTZhZDcifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "345dd381-77db-48bf-8a6a-bf63096af3ca", "content-length": "29", "date": "Thu, 21 May 2026 22:28:58 GMT"} })
2192026-05-21T22:28:58.129ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7
2202026-05-21T22:28:58.129ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 4 n_pruned_tasks = 0
2212026-05-21T22:28:58.130ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2222026-05-21T22:28:58.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2232026-05-21T22:28:58.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2242026-05-21T22:28:58.142ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2252026-05-21T22:28:58.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2262026-05-21T22:28:58.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2272026-05-21T22:28:58.148ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2282026-05-21T22:28:58.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
2292026-05-21T22:28:58.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
2302026-05-21T22:28:58.175ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 26 producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
2312026-05-21T22:28:59.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2322026-05-21T22:28:59.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2332026-05-21T22:28:59.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2342026-05-21T22:28:59.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2352026-05-21T22:28:59.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2362026-05-21T22:28:59.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2372026-05-21T22:29:00.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2382026-05-21T22:29:00.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2392026-05-21T22:29:00.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2402026-05-21T22:29:00.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2412026-05-21T22:29:00.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2422026-05-21T22:29:00.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2432026-05-21T22:29:00.952ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 199
2442026-05-21T22:29:00.952ZDEBGoximeter (clickhouse-client): unrolling 199 total samples collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
2452026-05-21T22:29:00.953ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 199
2462026-05-21T22:29:00.958ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
2472026-05-21T22:29:00.965ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 2 table_name = fields_ipaddr
2482026-05-21T22:29:00.967ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 105 table_name = fields_string
2492026-05-21T22:29:00.969ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 28 table_name = fields_u16
2502026-05-21T22:29:00.970ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 84 table_name = fields_uuid
2512026-05-21T22:29:00.972ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 131 table_name = measurements_cumulativeu64
2522026-05-21T22:29:00.975ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 26 table_name = measurements_histogramu64
2532026-05-21T22:29:00.976ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 42 table_name = measurements_u64
2542026-05-21T22:29:01.054ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
2552026-05-21T22:29:01.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2562026-05-21T22:29:01.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2572026-05-21T22:29:01.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2582026-05-21T22:29:01.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2592026-05-21T22:29:01.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2602026-05-21T22:29:01.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2612026-05-21T22:29:02.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2622026-05-21T22:29:02.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2632026-05-21T22:29:02.133ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2642026-05-21T22:29:02.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2652026-05-21T22:29:02.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2662026-05-21T22:29:02.148ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2672026-05-21T22:29:03.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2682026-05-21T22:29:03.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2692026-05-21T22:29:03.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2702026-05-21T22:29:03.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2712026-05-21T22:29:03.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2722026-05-21T22:29:03.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2732026-05-21T22:29:04.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2742026-05-21T22:29:04.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2752026-05-21T22:29:04.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2762026-05-21T22:29:04.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2772026-05-21T22:29:04.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2782026-05-21T22:29:04.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2792026-05-21T22:29:05.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2802026-05-21T22:29:05.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2812026-05-21T22:29:05.131ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2822026-05-21T22:29:05.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2832026-05-21T22:29:05.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2842026-05-21T22:29:05.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2852026-05-21T22:29:05.952ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 200
2862026-05-21T22:29:05.952ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 200
2872026-05-21T22:29:05.952ZDEBGoximeter (clickhouse-client): unrolling 200 total samples collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
2882026-05-21T22:29:05.959ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
2892026-05-21T22:29:05.965ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 52 table_name = fields_string
2902026-05-21T22:29:05.967ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 56 table_name = fields_uuid
2912026-05-21T22:29:05.968ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 150 table_name = measurements_cumulativeu64
2922026-05-21T22:29:05.970ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 50 table_name = measurements_u64
2932026-05-21T22:29:06.053ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
2942026-05-21T22:29:06.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2952026-05-21T22:29:06.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2962026-05-21T22:29:06.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2972026-05-21T22:29:06.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2982026-05-21T22:29:06.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2992026-05-21T22:29:06.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3002026-05-21T22:29:07.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3012026-05-21T22:29:07.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3022026-05-21T22:29:07.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3032026-05-21T22:29:07.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3042026-05-21T22:29:07.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3052026-05-21T22:29:07.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3062026-05-21T22:29:08.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3072026-05-21T22:29:08.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3082026-05-21T22:29:08.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3092026-05-21T22:29:08.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3102026-05-21T22:29:08.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3112026-05-21T22:29:08.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3122026-05-21T22:29:08.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
3132026-05-21T22:29:08.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
3142026-05-21T22:29:08.175ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 26 producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
3152026-05-21T22:29:09.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3162026-05-21T22:29:09.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3172026-05-21T22:29:09.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3182026-05-21T22:29:09.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3192026-05-21T22:29:09.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3202026-05-21T22:29:09.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3212026-05-21T22:29:10.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3222026-05-21T22:29:10.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3232026-05-21T22:29:10.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3242026-05-21T22:29:10.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3252026-05-21T22:29:10.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3262026-05-21T22:29:10.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3272026-05-21T22:29:10.951ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 226
3282026-05-21T22:29:10.951ZDEBGoximeter (clickhouse-client): unrolling 226 total samples collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
3292026-05-21T22:29:10.952ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 226
3302026-05-21T22:29:10.958ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
3312026-05-21T22:29:10.966ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 104 table_name = fields_string
3322026-05-21T22:29:10.968ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 26 table_name = fields_u16
3332026-05-21T22:29:10.969ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 82 table_name = fields_uuid
3342026-05-21T22:29:10.971ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 150 table_name = measurements_cumulativeu64
3352026-05-21T22:29:10.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 26 table_name = measurements_histogramu64
3362026-05-21T22:29:10.975ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 50 table_name = measurements_u64
3372026-05-21T22:29:11.054ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
3382026-05-21T22:29:11.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3392026-05-21T22:29:11.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3402026-05-21T22:29:11.133ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3412026-05-21T22:29:11.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3422026-05-21T22:29:11.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3432026-05-21T22:29:11.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3442026-05-21T22:29:12.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3452026-05-21T22:29:12.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3462026-05-21T22:29:12.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3472026-05-21T22:29:12.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3482026-05-21T22:29:12.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3492026-05-21T22:29:12.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3502026-05-21T22:29:13.120ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
3512026-05-21T22:29:13.120ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?sort_by=id_ascending
3522026-05-21T22:29:13.125ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f59099a-e2da-43a5-a7e0-2f41aec1cd35", "content-length": "859", "date": "Thu, 21 May 2026 22:29:13 GMT"} })
3532026-05-21T22:29:13.125ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI5YTdjMzgzYy1mYjE3LTQwNmUtYjQ2YS1jYzU5M2ZiNTZhZDcifX0%3D
3542026-05-21T22:29:13.128ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI5YTdjMzgzYy1mYjE3LTQwNmUtYjQ2YS1jYzU5M2ZiNTZhZDcifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "8981a878-41e9-46fd-98f9-44f718b66283", "content-length": "29", "date": "Thu, 21 May 2026 22:29:13 GMT"} })
3552026-05-21T22:29:13.128ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:61032 collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 2557e324-395e-4ee7-8ae2-2db14979b7f4
3562026-05-21T22:29:13.128ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 5 n_pruned_tasks = 0
3572026-05-21T22:29:13.129ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 2557e324-395e-4ee7-8ae2-2db14979b7f4 producer_ip = fd00:1122:3344:101::2 producer_port = 61032
3582026-05-21T22:29:13.129ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 2557e324-395e-4ee7-8ae2-2db14979b7f4 producer_ip = fd00:1122:3344:101::2 producer_port = 61032
3592026-05-21T22:29:13.129ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 2557e324-395e-4ee7-8ae2-2db14979b7f4 producer_ip = fd00:1122:3344:101::2 producer_port = 61032
3602026-05-21T22:29:13.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3612026-05-21T22:29:13.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3622026-05-21T22:29:13.133ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3632026-05-21T22:29:13.138ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 2557e324-395e-4ee7-8ae2-2db14979b7f4 producer_ip = fd00:1122:3344:101::2 producer_port = 61032
3642026-05-21T22:29:13.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3652026-05-21T22:29:13.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3662026-05-21T22:29:13.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 6499783b-d9df-450e-b448-6de0209fae81 producer_ip = fd00:1122:3344:101::2 producer_port = 39922
3672026-05-21T22:29:13.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 6499783b-d9df-450e-b448-6de0209fae81 producer_ip = fd00:1122:3344:101::2 producer_port = 39922
3682026-05-21T22:29:13.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3692026-05-21T22:29:13.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 36 producer_id = 6499783b-d9df-450e-b448-6de0209fae81 producer_ip = fd00:1122:3344:101::2 producer_port = 39922
3702026-05-21T22:29:14.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3712026-05-21T22:29:14.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3722026-05-21T22:29:14.133ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3732026-05-21T22:29:14.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3742026-05-21T22:29:14.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3752026-05-21T22:29:14.150ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3762026-05-21T22:29:15.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3772026-05-21T22:29:15.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3782026-05-21T22:29:15.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3792026-05-21T22:29:15.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3802026-05-21T22:29:15.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3812026-05-21T22:29:15.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3822026-05-21T22:29:15.951ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 248
3832026-05-21T22:29:15.951ZDEBGoximeter (clickhouse-client): unrolling 248 total samples collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
3842026-05-21T22:29:15.952ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 248
3852026-05-21T22:29:15.962ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
3862026-05-21T22:29:15.975ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 24 table_name = fields_i16
3872026-05-21T22:29:15.977ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 2 table_name = fields_ipaddr
3882026-05-21T22:29:15.979ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 195 table_name = fields_string
3892026-05-21T22:29:15.981ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 25 table_name = fields_u16
3902026-05-21T22:29:15.983ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 24 table_name = fields_u32
3912026-05-21T22:29:15.985ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 12 table_name = fields_u8
3922026-05-21T22:29:15.986ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 105 table_name = fields_uuid
3932026-05-21T22:29:15.988ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 187 table_name = measurements_cumulativeu64
3942026-05-21T22:29:15.991ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 11 table_name = measurements_histogramu64
3952026-05-21T22:29:15.993ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 50 table_name = measurements_u64
3962026-05-21T22:29:16.053ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
3972026-05-21T22:29:16.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3982026-05-21T22:29:16.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3992026-05-21T22:29:16.133ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4002026-05-21T22:29:16.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4012026-05-21T22:29:16.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4022026-05-21T22:29:16.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4032026-05-21T22:29:17.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4042026-05-21T22:29:17.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4052026-05-21T22:29:17.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4062026-05-21T22:29:17.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4072026-05-21T22:29:17.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4082026-05-21T22:29:17.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4092026-05-21T22:29:18.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4102026-05-21T22:29:18.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4112026-05-21T22:29:18.133ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4122026-05-21T22:29:18.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4132026-05-21T22:29:18.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4142026-05-21T22:29:18.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4152026-05-21T22:29:18.172ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
4162026-05-21T22:29:18.172ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
4172026-05-21T22:29:18.176ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 26 producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
4182026-05-21T22:29:19.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4192026-05-21T22:29:19.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4202026-05-21T22:29:19.133ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4212026-05-21T22:29:19.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4222026-05-21T22:29:19.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4232026-05-21T22:29:19.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4242026-05-21T22:29:20.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4252026-05-21T22:29:20.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4262026-05-21T22:29:20.133ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4272026-05-21T22:29:20.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4282026-05-21T22:29:20.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4292026-05-21T22:29:20.148ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4302026-05-21T22:29:20.952ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 226
4312026-05-21T22:29:20.952ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 226
4322026-05-21T22:29:20.952ZDEBGoximeter (clickhouse-client): unrolling 226 total samples collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
4332026-05-21T22:29:20.959ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
4342026-05-21T22:29:20.965ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 104 table_name = fields_string
4352026-05-21T22:29:20.966ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 26 table_name = fields_u16
4362026-05-21T22:29:20.968ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 82 table_name = fields_uuid
4372026-05-21T22:29:20.969ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 150 table_name = measurements_cumulativeu64
4382026-05-21T22:29:20.971ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 26 table_name = measurements_histogramu64
4392026-05-21T22:29:20.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 50 table_name = measurements_u64
4402026-05-21T22:29:21.054ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
4412026-05-21T22:29:21.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4422026-05-21T22:29:21.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4432026-05-21T22:29:21.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4442026-05-21T22:29:21.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4452026-05-21T22:29:21.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4462026-05-21T22:29:21.148ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4472026-05-21T22:29:22.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4482026-05-21T22:29:22.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4492026-05-21T22:29:22.133ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4502026-05-21T22:29:22.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4512026-05-21T22:29:22.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4522026-05-21T22:29:22.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4532026-05-21T22:29:23.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 2557e324-395e-4ee7-8ae2-2db14979b7f4 producer_ip = fd00:1122:3344:101::2 producer_port = 61032
4542026-05-21T22:29:23.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 2557e324-395e-4ee7-8ae2-2db14979b7f4 producer_ip = fd00:1122:3344:101::2 producer_port = 61032
4552026-05-21T22:29:23.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4562026-05-21T22:29:23.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4572026-05-21T22:29:23.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 2557e324-395e-4ee7-8ae2-2db14979b7f4 producer_ip = fd00:1122:3344:101::2 producer_port = 61032
4582026-05-21T22:29:23.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4592026-05-21T22:29:23.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4602026-05-21T22:29:23.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4612026-05-21T22:29:23.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4622026-05-21T22:29:24.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4632026-05-21T22:29:24.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4642026-05-21T22:29:24.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4652026-05-21T22:29:24.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4662026-05-21T22:29:24.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4672026-05-21T22:29:24.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4682026-05-21T22:29:25.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4692026-05-21T22:29:25.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4702026-05-21T22:29:25.133ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4712026-05-21T22:29:25.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4722026-05-21T22:29:25.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4732026-05-21T22:29:25.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4742026-05-21T22:29:25.951ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 211
4752026-05-21T22:29:25.951ZDEBGoximeter (clickhouse-client): unrolling 211 total samples collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
4762026-05-21T22:29:25.952ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 211
4772026-05-21T22:29:25.958ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
4782026-05-21T22:29:25.965ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 74 table_name = fields_string
4792026-05-21T22:29:25.967ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 11 table_name = fields_u16
4802026-05-21T22:29:25.968ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 67 table_name = fields_uuid
4812026-05-21T22:29:25.970ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 150 table_name = measurements_cumulativeu64
4822026-05-21T22:29:25.972ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 11 table_name = measurements_histogramu64
4832026-05-21T22:29:25.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 50 table_name = measurements_u64
4842026-05-21T22:29:26.054ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
4852026-05-21T22:29:26.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4862026-05-21T22:29:26.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4872026-05-21T22:29:26.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4882026-05-21T22:29:26.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4892026-05-21T22:29:26.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4902026-05-21T22:29:26.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4912026-05-21T22:29:27.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4922026-05-21T22:29:27.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4932026-05-21T22:29:27.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4942026-05-21T22:29:27.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4952026-05-21T22:29:27.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4962026-05-21T22:29:27.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4972026-05-21T22:29:28.121ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
4982026-05-21T22:29:28.121ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?sort_by=id_ascending
4992026-05-21T22:29:28.126ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8134148-d9bf-4edf-82eb-1e575655ff9d", "content-length": "1135", "date": "Thu, 21 May 2026 22:29:28 GMT"} })
5002026-05-21T22:29:28.126ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI5YTdjMzgzYy1mYjE3LTQwNmUtYjQ2YS1jYzU5M2ZiNTZhZDcifX0%3D
5012026-05-21T22:29:28.130ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI5YTdjMzgzYy1mYjE3LTQwNmUtYjQ2YS1jYzU5M2ZiNTZhZDcifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "d80ee556-17ff-46f5-8937-7a054a4a1beb", "content-length": "29", "date": "Thu, 21 May 2026 22:29:28 GMT"} })
5022026-05-21T22:29:28.130ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:47486 collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 281b6794-95eb-452d-9340-36cb1230137b
5032026-05-21T22:29:28.130ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:52307 collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 5fea1a28-0137-4483-aab5-9501b15dd557
5042026-05-21T22:29:28.130ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 7 n_pruned_tasks = 0
5052026-05-21T22:29:28.131ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 5fea1a28-0137-4483-aab5-9501b15dd557 producer_ip = fd00:1122:3344:101::c producer_port = 52307
5062026-05-21T22:29:28.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5072026-05-21T22:29:28.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5082026-05-21T22:29:28.131ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 281b6794-95eb-452d-9340-36cb1230137b producer_ip = fd00:1122:3344:101::b producer_port = 47486
5092026-05-21T22:29:28.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 5fea1a28-0137-4483-aab5-9501b15dd557 producer_ip = fd00:1122:3344:101::c producer_port = 52307
5102026-05-21T22:29:28.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 281b6794-95eb-452d-9340-36cb1230137b producer_ip = fd00:1122:3344:101::b producer_port = 47486
5112026-05-21T22:29:28.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 5fea1a28-0137-4483-aab5-9501b15dd557 producer_ip = fd00:1122:3344:101::c producer_port = 52307
5122026-05-21T22:29:28.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 281b6794-95eb-452d-9340-36cb1230137b producer_ip = fd00:1122:3344:101::b producer_port = 47486
5132026-05-21T22:29:28.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5142026-05-21T22:29:28.136ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 6 producer_id = 5fea1a28-0137-4483-aab5-9501b15dd557 producer_ip = fd00:1122:3344:101::c producer_port = 52307
5152026-05-21T22:29:28.139ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 281b6794-95eb-452d-9340-36cb1230137b producer_ip = fd00:1122:3344:101::b producer_port = 47486
5162026-05-21T22:29:28.141ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
5172026-05-21T22:29:28.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5182026-05-21T22:29:28.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5192026-05-21T22:29:28.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5202026-05-21T22:29:28.172ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
5212026-05-21T22:29:28.172ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
5222026-05-21T22:29:28.176ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 26 producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
5232026-05-21T22:29:29.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5242026-05-21T22:29:29.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5252026-05-21T22:29:29.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5262026-05-21T22:29:29.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5272026-05-21T22:29:29.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5282026-05-21T22:29:29.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5292026-05-21T22:29:30.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5302026-05-21T22:29:30.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5312026-05-21T22:29:30.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5322026-05-21T22:29:30.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5332026-05-21T22:29:30.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5342026-05-21T22:29:30.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5352026-05-21T22:29:30.951ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 237
5362026-05-21T22:29:30.951ZDEBGoximeter (clickhouse-client): unrolling 237 total samples collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
5372026-05-21T22:29:30.952ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 237
5382026-05-21T22:29:30.959ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
5392026-05-21T22:29:30.963ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("database_transaction:retry_data"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "attempt", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:29:30.955818180Z } timeseries_name = database_transaction:retry_data
5402026-05-21T22:29:30.964ZDEBGoximeter (clickhouse-client): inserting 1 new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
5412026-05-21T22:29:30.967ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 6 table_name = fields_ipaddr
5422026-05-21T22:29:30.968ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 116 table_name = fields_string
5432026-05-21T22:29:30.970ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 36 table_name = fields_u16
5442026-05-21T22:29:30.971ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 1 table_name = fields_u32
5452026-05-21T22:29:30.972ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 95 table_name = fields_uuid
5462026-05-21T22:29:30.974ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 153 table_name = measurements_cumulativeu64
5472026-05-21T22:29:30.975ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 1 table_name = measurements_f64
5482026-05-21T22:29:30.977ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 30 table_name = measurements_histogramu64
5492026-05-21T22:29:30.979ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 3 table_name = measurements_i64
5502026-05-21T22:29:30.980ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 50 table_name = measurements_u64
5512026-05-21T22:29:31.053ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
5522026-05-21T22:29:31.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5532026-05-21T22:29:31.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5542026-05-21T22:29:31.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5552026-05-21T22:29:31.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5562026-05-21T22:29:31.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5572026-05-21T22:29:31.150ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5582026-05-21T22:29:32.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5592026-05-21T22:29:32.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5602026-05-21T22:29:32.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5612026-05-21T22:29:32.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5622026-05-21T22:29:32.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5632026-05-21T22:29:32.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5642026-05-21T22:29:33.129ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 2557e324-395e-4ee7-8ae2-2db14979b7f4 producer_ip = fd00:1122:3344:101::2 producer_port = 61032
5652026-05-21T22:29:33.129ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 2557e324-395e-4ee7-8ae2-2db14979b7f4 producer_ip = fd00:1122:3344:101::2 producer_port = 61032
5662026-05-21T22:29:33.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5672026-05-21T22:29:33.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5682026-05-21T22:29:33.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 2557e324-395e-4ee7-8ae2-2db14979b7f4 producer_ip = fd00:1122:3344:101::2 producer_port = 61032
5692026-05-21T22:29:33.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5702026-05-21T22:29:33.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5712026-05-21T22:29:33.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5722026-05-21T22:29:33.148ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5732026-05-21T22:29:34.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5742026-05-21T22:29:34.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5752026-05-21T22:29:34.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5762026-05-21T22:29:34.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5772026-05-21T22:29:34.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5782026-05-21T22:29:34.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5792026-05-21T22:29:35.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5802026-05-21T22:29:35.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5812026-05-21T22:29:35.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5822026-05-21T22:29:35.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5832026-05-21T22:29:35.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5842026-05-21T22:29:35.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5852026-05-21T22:29:35.951ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 211
5862026-05-21T22:29:35.951ZDEBGoximeter (clickhouse-client): unrolling 211 total samples collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
5872026-05-21T22:29:35.952ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 211
5882026-05-21T22:29:35.958ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
5892026-05-21T22:29:35.964ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 74 table_name = fields_string
5902026-05-21T22:29:35.966ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 11 table_name = fields_u16
5912026-05-21T22:29:35.968ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 67 table_name = fields_uuid
5922026-05-21T22:29:35.970ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 150 table_name = measurements_cumulativeu64
5932026-05-21T22:29:35.972ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 11 table_name = measurements_histogramu64
5942026-05-21T22:29:35.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 50 table_name = measurements_u64
5952026-05-21T22:29:36.053ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
5962026-05-21T22:29:36.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5972026-05-21T22:29:36.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5982026-05-21T22:29:36.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5992026-05-21T22:29:36.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6002026-05-21T22:29:36.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6012026-05-21T22:29:36.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6022026-05-21T22:29:37.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6032026-05-21T22:29:37.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6042026-05-21T22:29:37.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6052026-05-21T22:29:37.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6062026-05-21T22:29:37.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6072026-05-21T22:29:37.150ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6082026-05-21T22:29:38.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6092026-05-21T22:29:38.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6102026-05-21T22:29:38.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 5fea1a28-0137-4483-aab5-9501b15dd557 producer_ip = fd00:1122:3344:101::c producer_port = 52307
6112026-05-21T22:29:38.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 281b6794-95eb-452d-9340-36cb1230137b producer_ip = fd00:1122:3344:101::b producer_port = 47486
6122026-05-21T22:29:38.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 281b6794-95eb-452d-9340-36cb1230137b producer_ip = fd00:1122:3344:101::b producer_port = 47486
6132026-05-21T22:29:38.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 5fea1a28-0137-4483-aab5-9501b15dd557 producer_ip = fd00:1122:3344:101::c producer_port = 52307
6142026-05-21T22:29:38.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 281b6794-95eb-452d-9340-36cb1230137b producer_ip = fd00:1122:3344:101::b producer_port = 47486
6152026-05-21T22:29:38.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 5fea1a28-0137-4483-aab5-9501b15dd557 producer_ip = fd00:1122:3344:101::c producer_port = 52307
6162026-05-21T22:29:38.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6172026-05-21T22:29:38.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6182026-05-21T22:29:38.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6192026-05-21T22:29:38.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6202026-05-21T22:29:38.172ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
6212026-05-21T22:29:38.172ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
6222026-05-21T22:29:38.175ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 26 producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
6232026-05-21T22:29:39.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6242026-05-21T22:29:39.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6252026-05-21T22:29:39.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6262026-05-21T22:29:39.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6272026-05-21T22:29:39.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6282026-05-21T22:29:39.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6292026-05-21T22:29:40.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6302026-05-21T22:29:40.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6312026-05-21T22:29:40.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6322026-05-21T22:29:40.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6332026-05-21T22:29:40.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6342026-05-21T22:29:40.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6352026-05-21T22:29:40.952ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 230
6362026-05-21T22:29:40.952ZDEBGoximeter (clickhouse-client): unrolling 230 total samples collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
6372026-05-21T22:29:40.953ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 230
6382026-05-21T22:29:40.959ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
6392026-05-21T22:29:40.966ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 112 table_name = fields_string
6402026-05-21T22:29:40.968ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 30 table_name = fields_u16
6412026-05-21T22:29:40.969ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 86 table_name = fields_uuid
6422026-05-21T22:29:40.971ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 150 table_name = measurements_cumulativeu64
6432026-05-21T22:29:40.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 30 table_name = measurements_histogramu64
6442026-05-21T22:29:40.975ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 50 table_name = measurements_u64
6452026-05-21T22:29:41.053ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
6462026-05-21T22:29:41.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6472026-05-21T22:29:41.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6482026-05-21T22:29:41.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6492026-05-21T22:29:41.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6502026-05-21T22:29:41.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6512026-05-21T22:29:41.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6522026-05-21T22:29:42.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6532026-05-21T22:29:42.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6542026-05-21T22:29:42.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6552026-05-21T22:29:42.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6562026-05-21T22:29:42.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6572026-05-21T22:29:42.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6582026-05-21T22:29:43.120ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
6592026-05-21T22:29:43.120ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?sort_by=id_ascending
6602026-05-21T22:29:43.123ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "37a21428-66d5-43c6-863b-8714546c74ea", "content-length": "1271", "date": "Thu, 21 May 2026 22:29:43 GMT"} })
6612026-05-21T22:29:43.123ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI5YTdjMzgzYy1mYjE3LTQwNmUtYjQ2YS1jYzU5M2ZiNTZhZDcifX0%3D
6622026-05-21T22:29:43.127ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI5YTdjMzgzYy1mYjE3LTQwNmUtYjQ2YS1jYzU5M2ZiNTZhZDcifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd66bfed-0404-4f6f-8625-4da434f2f146", "content-length": "29", "date": "Thu, 21 May 2026 22:29:43 GMT"} })
6632026-05-21T22:29:43.127ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a
6642026-05-21T22:29:43.127ZDEBGoximeter (oximeter-agent): received request to register existing metric producer, updating collection information address = [fd00:1122:3344:101::2]:49781 collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = 6499783b-d9df-450e-b448-6de0209fae81
6652026-05-21T22:29:43.127ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6662026-05-21T22:29:43.127ZDEBGoximeter (collection-task-handle): notified collection task of new producer endpoint collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 6499783b-d9df-450e-b448-6de0209fae81 producer_ip = fd00:1122:3344:101::2 producer_port = 39922
6672026-05-21T22:29:43.127ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 8 n_pruned_tasks = 0
6682026-05-21T22:29:43.127ZDEBGoximeter (collection-task): collection task received request to update its producer information address = [fd00:1122:3344:101::2]:49781 collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = 6499783b-d9df-450e-b448-6de0209fae81 producer_ip = fd00:1122:3344:101::2 producer_port = 39922
6692026-05-21T22:29:43.127ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6702026-05-21T22:29:43.128ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6712026-05-21T22:29:43.128ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 6499783b-d9df-450e-b448-6de0209fae81 producer_ip = fd00:1122:3344:101::2 producer_port = 39922
6722026-05-21T22:29:43.128ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 6499783b-d9df-450e-b448-6de0209fae81 producer_ip = fd00:1122:3344:101::2 producer_port = 39922
6732026-05-21T22:29:43.129ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 2557e324-395e-4ee7-8ae2-2db14979b7f4 producer_ip = fd00:1122:3344:101::2 producer_port = 61032
6742026-05-21T22:29:43.129ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 2557e324-395e-4ee7-8ae2-2db14979b7f4 producer_ip = fd00:1122:3344:101::2 producer_port = 61032
6752026-05-21T22:29:43.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6762026-05-21T22:29:43.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6772026-05-21T22:29:43.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6782026-05-21T22:29:43.133ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 2557e324-395e-4ee7-8ae2-2db14979b7f4 producer_ip = fd00:1122:3344:101::2 producer_port = 61032
6792026-05-21T22:29:43.138ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6802026-05-21T22:29:43.147ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6812026-05-21T22:29:43.147ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 6499783b-d9df-450e-b448-6de0209fae81 producer_ip = fd00:1122:3344:101::2 producer_port = 39922
6822026-05-21T22:29:43.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6832026-05-21T22:29:43.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6842026-05-21T22:29:43.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6852026-05-21T22:29:43.155ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 142 producer_id = 6499783b-d9df-450e-b448-6de0209fae81 producer_ip = fd00:1122:3344:101::2 producer_port = 39922
6862026-05-21T22:29:44.127ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6872026-05-21T22:29:44.127ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6882026-05-21T22:29:44.129ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6892026-05-21T22:29:44.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6902026-05-21T22:29:44.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6912026-05-21T22:29:44.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6922026-05-21T22:29:44.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6932026-05-21T22:29:44.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6942026-05-21T22:29:44.148ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6952026-05-21T22:29:45.128ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6962026-05-21T22:29:45.128ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6972026-05-21T22:29:45.129ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6982026-05-21T22:29:45.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6992026-05-21T22:29:45.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7002026-05-21T22:29:45.131ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7012026-05-21T22:29:45.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7022026-05-21T22:29:45.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7032026-05-21T22:29:45.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7042026-05-21T22:29:45.951ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 368
7052026-05-21T22:29:45.951ZDEBGoximeter (clickhouse-client): unrolling 368 total samples collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
7062026-05-21T22:29:45.953ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 368
7072026-05-21T22:29:45.965ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
7082026-05-21T22:29:45.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:29:45.961804146Z } timeseries_name = dendrite:sample_collection_duration
7092026-05-21T22:29:45.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:29:45.956383164Z } timeseries_name = mg_lower:routes_blocked_by_link_state
7102026-05-21T22:29:45.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:29:45.956261241Z } timeseries_name = static_routing_config:static_nexthops
7112026-05-21T22:29:45.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:29:45.956200819Z } timeseries_name = static_routing_config:static_routes
7122026-05-21T22:29:45.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:29:45.957270239Z } timeseries_name = switch_data_link:link_enabled
7132026-05-21T22:29:45.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:29:45.957335781Z } timeseries_name = switch_data_link:link_up
7142026-05-21T22:29:45.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:29:45.956321003Z } timeseries_name = switch_rib:active_routes
7152026-05-21T22:29:45.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:29:45.957517206Z } timeseries_name = switch_table:capacity
7162026-05-21T22:29:45.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:29:45.957820454Z } timeseries_name = switch_table:collisions
7172026-05-21T22:29:45.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:29:45.957946318Z } timeseries_name = switch_table:delete_misses
7182026-05-21T22:29:45.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:29:45.957699351Z } timeseries_name = switch_table:deletes
7192026-05-21T22:29:45.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:29:45.958007130Z } timeseries_name = switch_table:exhaustion
7202026-05-21T22:29:45.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:29:45.957638540Z } timeseries_name = switch_table:inserts
7212026-05-21T22:29:45.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:29:45.957577868Z } timeseries_name = switch_table:occupancy
7222026-05-21T22:29:45.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:29:45.957884666Z } timeseries_name = switch_table:update_misses
7232026-05-21T22:29:45.969ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-05-21T22:29:45.957759903Z } timeseries_name = switch_table:updates
7242026-05-21T22:29:45.973ZDEBGoximeter (clickhouse-client): inserting 16 new timeseries schema collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
7252026-05-21T22:29:45.977ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 284 table_name = fields_i16
7262026-05-21T22:29:45.978ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 6 table_name = fields_ipaddr
7272026-05-21T22:29:45.980ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 822 table_name = fields_string
7282026-05-21T22:29:45.982ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 159 table_name = fields_u16
7292026-05-21T22:29:45.983ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 149 table_name = fields_u32
7302026-05-21T22:29:45.984ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 148 table_name = fields_u8
7312026-05-21T22:29:45.986ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 507 table_name = fields_uuid
7322026-05-21T22:29:45.987ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 6 table_name = measurements_bool
7332026-05-21T22:29:45.989ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 264 table_name = measurements_cumulativeu64
7342026-05-21T22:29:45.990ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 1 table_name = measurements_f64
7352026-05-21T22:29:45.992ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 11 table_name = measurements_histogramu64
7362026-05-21T22:29:45.993ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 86 table_name = measurements_u64
7372026-05-21T22:29:46.054ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
7382026-05-21T22:29:46.128ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7392026-05-21T22:29:46.128ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7402026-05-21T22:29:46.129ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7412026-05-21T22:29:46.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7422026-05-21T22:29:46.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7432026-05-21T22:29:46.133ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7442026-05-21T22:29:46.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7452026-05-21T22:29:46.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7462026-05-21T22:29:46.148ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7472026-05-21T22:29:47.127ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7482026-05-21T22:29:47.127ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7492026-05-21T22:29:47.128ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7502026-05-21T22:29:47.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7512026-05-21T22:29:47.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7522026-05-21T22:29:47.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7532026-05-21T22:29:47.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7542026-05-21T22:29:47.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7552026-05-21T22:29:47.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7562026-05-21T22:29:48.127ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7572026-05-21T22:29:48.127ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7582026-05-21T22:29:48.128ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7592026-05-21T22:29:48.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7602026-05-21T22:29:48.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7612026-05-21T22:29:48.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 281b6794-95eb-452d-9340-36cb1230137b producer_ip = fd00:1122:3344:101::b producer_port = 47486
7622026-05-21T22:29:48.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 5fea1a28-0137-4483-aab5-9501b15dd557 producer_ip = fd00:1122:3344:101::c producer_port = 52307
7632026-05-21T22:29:48.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 281b6794-95eb-452d-9340-36cb1230137b producer_ip = fd00:1122:3344:101::b producer_port = 47486
7642026-05-21T22:29:48.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 5fea1a28-0137-4483-aab5-9501b15dd557 producer_ip = fd00:1122:3344:101::c producer_port = 52307
7652026-05-21T22:29:48.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 5fea1a28-0137-4483-aab5-9501b15dd557 producer_ip = fd00:1122:3344:101::c producer_port = 52307
7662026-05-21T22:29:48.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 281b6794-95eb-452d-9340-36cb1230137b producer_ip = fd00:1122:3344:101::b producer_port = 47486
7672026-05-21T22:29:48.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7682026-05-21T22:29:48.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7692026-05-21T22:29:48.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7702026-05-21T22:29:48.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7712026-05-21T22:29:48.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
7722026-05-21T22:29:48.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
7732026-05-21T22:29:48.176ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 26 producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
7742026-05-21T22:29:49.128ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7752026-05-21T22:29:49.128ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7762026-05-21T22:29:49.129ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7772026-05-21T22:29:49.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7782026-05-21T22:29:49.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7792026-05-21T22:29:49.133ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7802026-05-21T22:29:49.147ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7812026-05-21T22:29:49.147ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7822026-05-21T22:29:49.150ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7832026-05-21T22:29:50.128ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7842026-05-21T22:29:50.128ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7852026-05-21T22:29:50.129ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7862026-05-21T22:29:50.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7872026-05-21T22:29:50.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7882026-05-21T22:29:50.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7892026-05-21T22:29:50.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7902026-05-21T22:29:50.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7912026-05-21T22:29:50.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7922026-05-21T22:29:50.951ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 250
7932026-05-21T22:29:50.951ZDEBGoximeter (clickhouse-client): unrolling 250 total samples collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
7942026-05-21T22:29:50.952ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 250
7952026-05-21T22:29:50.959ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
7962026-05-21T22:29:50.966ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 116 table_name = fields_string
7972026-05-21T22:29:50.967ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 30 table_name = fields_u16
7982026-05-21T22:29:50.969ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 94 table_name = fields_uuid
7992026-05-21T22:29:50.971ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 160 table_name = measurements_cumulativeu64
8002026-05-21T22:29:50.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 30 table_name = measurements_histogramu64
8012026-05-21T22:29:50.974ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 60 table_name = measurements_u64
8022026-05-21T22:29:51.053ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
8032026-05-21T22:29:51.127ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8042026-05-21T22:29:51.128ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8052026-05-21T22:29:51.128ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8062026-05-21T22:29:51.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8072026-05-21T22:29:51.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8082026-05-21T22:29:51.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8092026-05-21T22:29:51.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8102026-05-21T22:29:51.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8112026-05-21T22:29:51.149ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8122026-05-21T22:29:52.127ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8132026-05-21T22:29:52.127ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8142026-05-21T22:29:52.128ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8152026-05-21T22:29:52.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8162026-05-21T22:29:52.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8172026-05-21T22:29:52.131ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8182026-05-21T22:29:52.145ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8192026-05-21T22:29:52.145ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8202026-05-21T22:29:52.148ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8212026-05-21T22:29:53.127ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8222026-05-21T22:29:53.127ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8232026-05-21T22:29:53.127ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 6499783b-d9df-450e-b448-6de0209fae81 producer_ip = fd00:1122:3344:101::2 producer_port = 39922
8242026-05-21T22:29:53.127ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 6499783b-d9df-450e-b448-6de0209fae81 producer_ip = fd00:1122:3344:101::2 producer_port = 39922
8252026-05-21T22:29:53.127ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8262026-05-21T22:29:53.128ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 2557e324-395e-4ee7-8ae2-2db14979b7f4 producer_ip = fd00:1122:3344:101::2 producer_port = 61032
8272026-05-21T22:29:53.128ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 2557e324-395e-4ee7-8ae2-2db14979b7f4 producer_ip = fd00:1122:3344:101::2 producer_port = 61032
8282026-05-21T22:29:53.129ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8292026-05-21T22:29:53.129ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8302026-05-21T22:29:53.130ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 2557e324-395e-4ee7-8ae2-2db14979b7f4 producer_ip = fd00:1122:3344:101::2 producer_port = 61032
8312026-05-21T22:29:53.131ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8322026-05-21T22:29:53.140ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 142 producer_id = 6499783b-d9df-450e-b448-6de0209fae81 producer_ip = fd00:1122:3344:101::2 producer_port = 39922
8332026-05-21T22:29:53.145ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8342026-05-21T22:29:53.145ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8352026-05-21T22:29:53.147ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8362026-05-21T22:29:54.126ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8372026-05-21T22:29:54.126ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8382026-05-21T22:29:54.127ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8392026-05-21T22:29:54.129ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8402026-05-21T22:29:54.129ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8412026-05-21T22:29:54.131ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8422026-05-21T22:29:54.145ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8432026-05-21T22:29:54.145ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8442026-05-21T22:29:54.147ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8452026-05-21T22:29:55.126ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8462026-05-21T22:29:55.126ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8472026-05-21T22:29:55.127ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8482026-05-21T22:29:55.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8492026-05-21T22:29:55.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8502026-05-21T22:29:55.131ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8512026-05-21T22:29:55.145ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8522026-05-21T22:29:55.145ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8532026-05-21T22:29:55.148ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8542026-05-21T22:29:55.950ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 373
8552026-05-21T22:29:55.950ZDEBGoximeter (clickhouse-client): unrolling 373 total samples collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
8562026-05-21T22:29:55.951ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 373
8572026-05-21T22:29:55.962ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
8582026-05-21T22:29:55.972ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 284 table_name = fields_i16
8592026-05-21T22:29:55.974ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 819 table_name = fields_string
8602026-05-21T22:29:55.976ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 153 table_name = fields_u16
8612026-05-21T22:29:55.977ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 149 table_name = fields_u32
8622026-05-21T22:29:55.979ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 148 table_name = fields_u8
8632026-05-21T22:29:55.981ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 501 table_name = fields_uuid
8642026-05-21T22:29:55.982ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 6 table_name = measurements_bool
8652026-05-21T22:29:55.984ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 265 table_name = measurements_cumulativeu64
8662026-05-21T22:29:55.986ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 1 table_name = measurements_f64
8672026-05-21T22:29:55.988ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 11 table_name = measurements_histogramu64
8682026-05-21T22:29:55.989ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 90 table_name = measurements_u64
8692026-05-21T22:29:56.052ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
8702026-05-21T22:29:56.126ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8712026-05-21T22:29:56.126ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8722026-05-21T22:29:56.127ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8732026-05-21T22:29:56.129ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8742026-05-21T22:29:56.129ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8752026-05-21T22:29:56.131ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8762026-05-21T22:29:56.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8772026-05-21T22:29:56.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8782026-05-21T22:29:56.148ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8792026-05-21T22:29:57.126ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8802026-05-21T22:29:57.126ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8812026-05-21T22:29:57.127ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8822026-05-21T22:29:57.129ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8832026-05-21T22:29:57.129ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8842026-05-21T22:29:57.130ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8852026-05-21T22:29:57.145ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8862026-05-21T22:29:57.145ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8872026-05-21T22:29:57.148ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8882026-05-21T22:29:58.119ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
8892026-05-21T22:29:58.119ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?sort_by=id_ascending
8902026-05-21T22:29:58.122ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc4438dc-e1e9-4860-902a-068d5a96e3ea", "content-length": "1271", "date": "Thu, 21 May 2026 22:29:58 GMT"} })
8912026-05-21T22:29:58.122ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI5YTdjMzgzYy1mYjE3LTQwNmUtYjQ2YS1jYzU5M2ZiNTZhZDcifX0%3D
8922026-05-21T22:29:58.125ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/3766df1f-59e2-4938-93ac-1372dbbc9e67/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI5YTdjMzgzYy1mYjE3LTQwNmUtYjQ2YS1jYzU5M2ZiNTZhZDcifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bb3d617-873f-4aec-9ec0-f976425a5636", "content-length": "29", "date": "Thu, 21 May 2026 22:29:58 GMT"} })
8932026-05-21T22:29:58.125ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 8 n_pruned_tasks = 0
8942026-05-21T22:29:58.127ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8952026-05-21T22:29:58.127ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8962026-05-21T22:29:58.127ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8972026-05-21T22:29:58.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 5fea1a28-0137-4483-aab5-9501b15dd557 producer_ip = fd00:1122:3344:101::c producer_port = 52307
8982026-05-21T22:29:58.130ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8992026-05-21T22:29:58.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 5fea1a28-0137-4483-aab5-9501b15dd557 producer_ip = fd00:1122:3344:101::c producer_port = 52307
9002026-05-21T22:29:58.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 281b6794-95eb-452d-9340-36cb1230137b producer_ip = fd00:1122:3344:101::b producer_port = 47486
9012026-05-21T22:29:58.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 281b6794-95eb-452d-9340-36cb1230137b producer_ip = fd00:1122:3344:101::b producer_port = 47486
9022026-05-21T22:29:58.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9032026-05-21T22:29:58.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9042026-05-21T22:29:58.130ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 5fea1a28-0137-4483-aab5-9501b15dd557 producer_ip = fd00:1122:3344:101::c producer_port = 52307
9052026-05-21T22:29:58.131ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 281b6794-95eb-452d-9340-36cb1230137b producer_ip = fd00:1122:3344:101::b producer_port = 47486
9062026-05-21T22:29:58.131ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9072026-05-21T22:29:58.145ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9082026-05-21T22:29:58.145ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9092026-05-21T22:29:58.148ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9102026-05-21T22:29:58.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
9112026-05-21T22:29:58.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
9122026-05-21T22:29:58.175ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 26 producer_id = 05476aa7-1d4f-4496-aff9-185679dfabc5 producer_ip = fd00:1122:3344:101::a producer_port = 60682
9132026-05-21T22:29:59.127ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9142026-05-21T22:29:59.127ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9152026-05-21T22:29:59.128ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9162026-05-21T22:29:59.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9172026-05-21T22:29:59.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9182026-05-21T22:29:59.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9192026-05-21T22:29:59.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9202026-05-21T22:29:59.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9212026-05-21T22:29:59.148ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9222026-05-21T22:30:00.127ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9232026-05-21T22:30:00.127ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9242026-05-21T22:30:00.128ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9252026-05-21T22:30:00.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9262026-05-21T22:30:00.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9272026-05-21T22:30:00.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9282026-05-21T22:30:00.145ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9292026-05-21T22:30:00.145ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9302026-05-21T22:30:00.148ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9312026-05-21T22:30:00.951ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 251
9322026-05-21T22:30:00.951ZDEBGoximeter (clickhouse-client): unrolling 251 total samples collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
9332026-05-21T22:30:00.952ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_samples = 251
9342026-05-21T22:30:00.959ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5
9352026-05-21T22:30:00.967ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 2 table_name = fields_ipaddr
9362026-05-21T22:30:00.969ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 117 table_name = fields_string
9372026-05-21T22:30:00.970ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 32 table_name = fields_u16
9382026-05-21T22:30:00.972ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 96 table_name = fields_uuid
9392026-05-21T22:30:00.973ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 161 table_name = measurements_cumulativeu64
9402026-05-21T22:30:00.976ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 30 table_name = measurements_histogramu64
9412026-05-21T22:30:00.977ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d id = d3cb40ea-f285-482e-931a-f456e9ce5ab5 n_rows = 60 table_name = measurements_u64
9422026-05-21T22:30:01.053ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
9432026-05-21T22:30:01.127ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9442026-05-21T22:30:01.127ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9452026-05-21T22:30:01.128ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 42e4276e-9325-4e5e-b62f-d2b11d78c61a producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9462026-05-21T22:30:01.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9472026-05-21T22:30:01.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9482026-05-21T22:30:01.131ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 9a7c383c-fb17-406e-b46a-cc593fb56ad7 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9492026-05-21T22:30:01.146ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9502026-05-21T22:30:01.146ZDEBGoximeter (collection-task): collecting from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9512026-05-21T22:30:01.148ZDEBGoximeter (collection-task): collected results from producer collector_id = 3766df1f-59e2-4938-93ac-1372dbbc9e67 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 07966c8d-4659-4fc5-bfcc-8b1b33f87c97 producer_ip = fd00:1122:3344:101::1 producer_port = 8001