Max level shown:
1 [ Aug 19 21:12:40 Enabled. ]
2 [ Aug 19 21:12:40 Rereading configuration. ]
3 [ Aug 19 21:12:42 Rereading configuration. ]
4 [ Aug 19 21:12:43 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id 5dceac3a-cd82-4fea-877e-db974700937c &"). ]
5 [ Aug 19 21:12:43 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-08-19T21:12:44.094ZDEBGoximeter: registered DTrace probes
82026-08-19T21:12:44.104ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:299
92026-08-19T21:12:44.105ZDEBGoximeter: creating ClickHouse client
102026-08-19T21:12:44.112ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
112026-08-19T21:12:48.380ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:888 id = d8a68822-dedf-4396-8e13-88cc820cfcba
122026-08-19T21:12:48.380ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d
132026-08-19T21:12:48.380ZINFOoximeter (clickhouse-client): reading db version collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:788 id = d8a68822-dedf-4396-8e13-88cc820cfcba
142026-08-19T21:12:48.381ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:888 id = d8a68822-dedf-4396-8e13-88cc820cfcba
152026-08-19T21:12:48.381ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:793 id = d8a68822-dedf-4396-8e13-88cc820cfcba version = 0
162026-08-19T21:12:48.381ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:798 id = d8a68822-dedf-4396-8e13-88cc820cfcba
172026-08-19T21:12:48.381ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
182026-08-19T21:12:48.494ZINFOoximeter (clickhouse-client): inserting current version collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:819 id = d8a68822-dedf-4396-8e13-88cc820cfcba version = 14
192026-08-19T21:12:48.529ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = 9390bca1-3242-41bf-9d05-975714868aa4
202026-08-19T21:12:48.542ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-08-19T21:12:48.542ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-08-19T21:12:48.542ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-08-19T21:12:48.542ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-08-19T21:12:48.542ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:335 local_addr = [fd00:1122:3344:101::d]:12223
252026-08-19T21:12:48.546ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-08-19T21:12:48.546ZDEBGoximeter: registered USDT probes
272026-08-19T21:12:48.546ZDEBGoximeter: contacting nexus
282026-08-19T21:12:48.571ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
292026-08-19T21:12:48.573ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
302026-08-19T21:12:48.573ZWARNoximeter: failed to contact nexus, will retry in 346.582893ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:413
312026-08-19T21:12:48.920ZDEBGoximeter: contacting nexus
322026-08-19T21:12:48.920ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
332026-08-19T21:12:48.920ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::c]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
342026-08-19T21:12:48.920ZWARNoximeter: failed to contact nexus, will retry in 344.682706ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:413
352026-08-19T21:12:49.266ZDEBGoximeter: contacting nexus
362026-08-19T21:12:49.267ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
372026-08-19T21:12:49.267ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::c]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
382026-08-19T21:12:49.267ZWARNoximeter: failed to contact nexus, will retry in 1.252613824s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:413
392026-08-19T21:12:50.520ZDEBGoximeter: contacting nexus
402026-08-19T21:12:50.520ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
412026-08-19T21:12:50.520ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::c]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
422026-08-19T21:12:50.520ZWARNoximeter: failed to contact nexus, will retry in 2.80648205s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:413
432026-08-19T21:12:53.328ZDEBGoximeter: contacting nexus
442026-08-19T21:12:53.329ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
452026-08-19T21:12:53.471ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "474ae360-4907-4615-ab66-8d1d7d1287fd", "date": "Wed, 19 Aug 2026 21:12:53 GMT"} })
462026-08-19T21:12:53.471ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:431 id = 5dceac3a-cd82-4fea-877e-db974700937c
472026-08-19T21:12:53.471ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:626
482026-08-19T21:12:53.472ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
492026-08-19T21:12:53.475ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?sort_by=id_ascending
502026-08-19T21:12:53.476ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?sort_by=id_ascending", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
512026-08-19T21:12:53.478ZERROoximeter (oximeter-agent): error fetching next assigned producer, abandoning this refresh attempt collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?sort_by=id_ascending): error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?sort_by=id_ascending): client error (Connect): tcp connect error: Connection refused (os error 146) file = oximeter/collector/src/agent.rs:667
522026-08-19T21:12:53.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 4
532026-08-19T21:12:53.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 4
542026-08-19T21:12:53.530ZDEBGoximeter (clickhouse-client): unrolling 4 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
552026-08-19T21:12:53.531ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
562026-08-19T21:12:53.532ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:database_queue_depth"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "collector_sink", field_type: String, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:12:53.530990858Z } timeseries_name = oximeter_collector:database_queue_depth
572026-08-19T21:12:53.532ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:database_samples_dropped"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "collector_sink", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:12:53.530986388Z } timeseries_name = oximeter_collector:database_samples_dropped
582026-08-19T21:12:53.532ZDEBGoximeter (clickhouse-client): inserting 2 new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
592026-08-19T21:12:53.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = fields_ipaddr
602026-08-19T21:12:53.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = fields_string
612026-08-19T21:12:53.541ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = fields_u16
622026-08-19T21:12:53.544ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = fields_uuid
632026-08-19T21:12:53.546ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 2 table_name = measurements_cumulativeu64
642026-08-19T21:12:53.551ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 2 table_name = measurements_histogramu64
652026-08-19T21:12:53.631ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
662026-08-19T21:12:58.530ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d
672026-08-19T21:12:58.530ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d
682026-08-19T21:13:03.530ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d
692026-08-19T21:13:03.530ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d
702026-08-19T21:13:08.472ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
712026-08-19T21:13:08.473ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?sort_by=id_ascending
722026-08-19T21:13:08.479ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f0daaea-31e9-4756-aaf9-bc4561434af4", "content-length": "585", "date": "Wed, 19 Aug 2026 21:13:08 GMT"} })
732026-08-19T21:13:08.482ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI1ZWYwZTY3ZS02YzRiLTQ5MjMtYmI2MS0yNzliNTRmMzdhNjEifX0%3D
742026-08-19T21:13:08.485ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI1ZWYwZTY3ZS02YzRiLTQ5MjMtYmI2MS0yNzliNTRmMzdhNjEifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd899831-189d-406d-8d28-20617842c133", "content-length": "29", "date": "Wed, 19 Aug 2026 21:13:08 GMT"} })
752026-08-19T21:13:08.485ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:33301 collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe
762026-08-19T21:13:08.485ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498
772026-08-19T21:13:08.485ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:46255 collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61
782026-08-19T21:13:08.485ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 3 n_pruned_tasks = 0
792026-08-19T21:13:08.530ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d
802026-08-19T21:13:08.531ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d
812026-08-19T21:13:09.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
822026-08-19T21:13:09.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
832026-08-19T21:13:09.275ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
842026-08-19T21:13:10.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
852026-08-19T21:13:10.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
862026-08-19T21:13:10.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
872026-08-19T21:13:11.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
882026-08-19T21:13:11.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
892026-08-19T21:13:11.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
902026-08-19T21:13:11.642ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
912026-08-19T21:13:11.642ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
922026-08-19T21:13:11.670ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
932026-08-19T21:13:12.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
942026-08-19T21:13:12.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
952026-08-19T21:13:12.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
962026-08-19T21:13:13.255ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
972026-08-19T21:13:13.255ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
982026-08-19T21:13:13.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
992026-08-19T21:13:13.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 270
1002026-08-19T21:13:13.531ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 270
1012026-08-19T21:13:13.531ZDEBGoximeter (clickhouse-client): unrolling 270 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
1022026-08-19T21:13:13.531ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
1032026-08-19T21:13:13.537ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.530959275Z } timeseries_name = ddm_router:originated_tunnel_endpoints
1042026-08-19T21:13:13.537ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.530955255Z } timeseries_name = ddm_router:originated_underlay_prefixes
1052026-08-19T21:13:13.537ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.530971386Z } timeseries_name = ddm_session:advertisements_received
1062026-08-19T21:13:13.537ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.530968406Z } timeseries_name = ddm_session:advertisements_sent
1072026-08-19T21:13:13.537ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.530990396Z } timeseries_name = ddm_session:imported_tunnel_endpoints
1082026-08-19T21:13:13.537ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.530988136Z } timeseries_name = ddm_session:imported_underlay_prefixes
1092026-08-19T21:13:13.537ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.530975676Z } timeseries_name = ddm_session:peer_address_changes
1102026-08-19T21:13:13.537ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.530973566Z } timeseries_name = ddm_session:peer_expirations
1112026-08-19T21:13:13.537ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.530978476Z } timeseries_name = ddm_session:peer_sessions_established
1122026-08-19T21:13:13.537ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.530965635Z } timeseries_name = ddm_session:solicitations_received
1132026-08-19T21:13:13.537ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.530963006Z } timeseries_name = ddm_session:solicitations_sent
1142026-08-19T21:13:13.537ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.530984836Z } timeseries_name = ddm_session:update_send_fail
1152026-08-19T21:13:13.538ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.530982756Z } timeseries_name = ddm_session:updates_received
1162026-08-19T21:13:13.538ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.530980606Z } timeseries_name = ddm_session:updates_sent
1172026-08-19T21:13:13.538ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.531156080Z } timeseries_name = dendrite:sample_collection_duration
1182026-08-19T21:13:13.538ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.531026707Z } timeseries_name = switch_data_link:link_enabled
1192026-08-19T21:13:13.538ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.531034747Z } timeseries_name = switch_data_link:link_up
1202026-08-19T21:13:13.538ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.531042167Z } timeseries_name = switch_table:capacity
1212026-08-19T21:13:13.538ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.531077798Z } timeseries_name = switch_table:collisions
1222026-08-19T21:13:13.538ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.531092298Z } timeseries_name = switch_table:delete_misses
1232026-08-19T21:13:13.538ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.531065728Z } timeseries_name = switch_table:deletes
1242026-08-19T21:13:13.538ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.531105279Z } timeseries_name = switch_table:exhaustion
1252026-08-19T21:13:13.538ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.531053208Z } timeseries_name = switch_table:inserts
1262026-08-19T21:13:13.539ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.531048208Z } timeseries_name = switch_table:occupancy
1272026-08-19T21:13:13.539ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.531087778Z } timeseries_name = switch_table:update_misses
1282026-08-19T21:13:13.539ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:13.531072188Z } timeseries_name = switch_table:updates
1292026-08-19T21:13:13.542ZDEBGoximeter (clickhouse-client): inserting 26 new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
1302026-08-19T21:13:13.553ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 280 table_name = fields_i16
1312026-08-19T21:13:13.556ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 771 table_name = fields_string
1322026-08-19T21:13:13.558ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 140 table_name = fields_u16
1332026-08-19T21:13:13.560ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 145 table_name = fields_u32
1342026-08-19T21:13:13.562ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 144 table_name = fields_u8
1352026-08-19T21:13:13.563ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 472 table_name = fields_uuid
1362026-08-19T21:13:13.565ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = measurements_bool
1372026-08-19T21:13:13.569ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 205 table_name = measurements_cumulativeu64
1382026-08-19T21:13:13.571ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 1 table_name = measurements_f64
1392026-08-19T21:13:13.574ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 60 table_name = measurements_u64
1402026-08-19T21:13:13.631ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1412026-08-19T21:13:14.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1422026-08-19T21:13:14.255ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1432026-08-19T21:13:14.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1442026-08-19T21:13:14.970ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
1452026-08-19T21:13:14.970ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
1462026-08-19T21:13:14.978ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
1472026-08-19T21:13:15.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1482026-08-19T21:13:15.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1492026-08-19T21:13:15.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1502026-08-19T21:13:16.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1512026-08-19T21:13:16.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1522026-08-19T21:13:16.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1532026-08-19T21:13:17.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1542026-08-19T21:13:17.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1552026-08-19T21:13:17.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1562026-08-19T21:13:18.255ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1572026-08-19T21:13:18.255ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1582026-08-19T21:13:18.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1592026-08-19T21:13:18.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 141
1602026-08-19T21:13:18.531ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 141
1612026-08-19T21:13:18.531ZDEBGoximeter (clickhouse-client): unrolling 141 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
1622026-08-19T21:13:18.531ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
1632026-08-19T21:13:18.568ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:18.530994128Z } timeseries_name = http_service:request_latency_histogram
1642026-08-19T21:13:18.569ZDEBGoximeter (clickhouse-client): inserting 1 new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
1652026-08-19T21:13:18.573ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 72 table_name = fields_string
1662026-08-19T21:13:18.575ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 11 table_name = fields_u16
1672026-08-19T21:13:18.577ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 63 table_name = fields_uuid
1682026-08-19T21:13:18.579ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 100 table_name = measurements_cumulativeu64
1692026-08-19T21:13:18.581ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 11 table_name = measurements_histogramu64
1702026-08-19T21:13:18.583ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 30 table_name = measurements_u64
1712026-08-19T21:13:18.631ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1722026-08-19T21:13:19.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1732026-08-19T21:13:19.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1742026-08-19T21:13:19.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1752026-08-19T21:13:20.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1762026-08-19T21:13:20.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1772026-08-19T21:13:20.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1782026-08-19T21:13:21.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1792026-08-19T21:13:21.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1802026-08-19T21:13:21.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1812026-08-19T21:13:21.642ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
1822026-08-19T21:13:21.642ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
1832026-08-19T21:13:21.652ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
1842026-08-19T21:13:22.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1852026-08-19T21:13:22.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1862026-08-19T21:13:22.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1872026-08-19T21:13:23.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1882026-08-19T21:13:23.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1892026-08-19T21:13:23.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1902026-08-19T21:13:23.472ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
1912026-08-19T21:13:23.472ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?sort_by=id_ascending
1922026-08-19T21:13:23.472ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?sort_by=id_ascending", source: hyper_util::client::legacy::Error(SendRequest, hyper::Error(IncompleteMessage)) })
1932026-08-19T21:13:23.472ZERROoximeter (oximeter-agent): error fetching next assigned producer, abandoning this refresh attempt collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?sort_by=id_ascending): error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?sort_by=id_ascending): client error (SendRequest): connection closed before message completed file = oximeter/collector/src/agent.rs:667
1942026-08-19T21:13:23.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 270
1952026-08-19T21:13:23.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 270
1962026-08-19T21:13:23.530ZDEBGoximeter (clickhouse-client): unrolling 270 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
1972026-08-19T21:13:23.530ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
1982026-08-19T21:13:23.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 280 table_name = fields_i16
1992026-08-19T21:13:23.540ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 771 table_name = fields_string
2002026-08-19T21:13:23.542ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 140 table_name = fields_u16
2012026-08-19T21:13:23.544ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 145 table_name = fields_u32
2022026-08-19T21:13:23.546ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 144 table_name = fields_u8
2032026-08-19T21:13:23.548ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 472 table_name = fields_uuid
2042026-08-19T21:13:23.550ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = measurements_bool
2052026-08-19T21:13:23.551ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 205 table_name = measurements_cumulativeu64
2062026-08-19T21:13:23.553ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 1 table_name = measurements_f64
2072026-08-19T21:13:23.554ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 60 table_name = measurements_u64
2082026-08-19T21:13:23.631ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2092026-08-19T21:13:24.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2102026-08-19T21:13:24.255ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2112026-08-19T21:13:24.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2122026-08-19T21:13:24.970ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
2132026-08-19T21:13:24.970ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
2142026-08-19T21:13:24.972ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
2152026-08-19T21:13:25.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2162026-08-19T21:13:25.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2172026-08-19T21:13:25.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2182026-08-19T21:13:26.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2192026-08-19T21:13:26.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2202026-08-19T21:13:26.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2212026-08-19T21:13:27.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2222026-08-19T21:13:27.255ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2232026-08-19T21:13:27.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2242026-08-19T21:13:28.255ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2252026-08-19T21:13:28.255ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2262026-08-19T21:13:28.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2272026-08-19T21:13:28.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 141
2282026-08-19T21:13:28.531ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 141
2292026-08-19T21:13:28.531ZDEBGoximeter (clickhouse-client): unrolling 141 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
2302026-08-19T21:13:28.531ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
2312026-08-19T21:13:28.543ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 72 table_name = fields_string
2322026-08-19T21:13:28.544ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 11 table_name = fields_u16
2332026-08-19T21:13:28.546ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 63 table_name = fields_uuid
2342026-08-19T21:13:28.548ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 100 table_name = measurements_cumulativeu64
2352026-08-19T21:13:28.550ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 11 table_name = measurements_histogramu64
2362026-08-19T21:13:28.552ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 30 table_name = measurements_u64
2372026-08-19T21:13:28.631ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2382026-08-19T21:13:28.752ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2392026-08-19T21:13:29.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2402026-08-19T21:13:29.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2412026-08-19T21:13:29.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2422026-08-19T21:13:30.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2432026-08-19T21:13:30.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2442026-08-19T21:13:30.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2452026-08-19T21:13:31.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2462026-08-19T21:13:31.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2472026-08-19T21:13:31.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2482026-08-19T21:13:31.642ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
2492026-08-19T21:13:31.642ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
2502026-08-19T21:13:31.650ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
2512026-08-19T21:13:32.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2522026-08-19T21:13:32.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2532026-08-19T21:13:32.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2542026-08-19T21:13:33.255ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2552026-08-19T21:13:33.255ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2562026-08-19T21:13:33.257ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2572026-08-19T21:13:33.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 272
2582026-08-19T21:13:33.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 272
2592026-08-19T21:13:33.530ZDEBGoximeter (clickhouse-client): unrolling 272 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
2602026-08-19T21:13:33.530ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
2612026-08-19T21:13:33.533ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:33.530209630Z } timeseries_name = oximeter_collector:collections
2622026-08-19T21:13:33.533ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:samples_collected"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:33.530213440Z } timeseries_name = oximeter_collector:samples_collected
2632026-08-19T21:13:33.536ZDEBGoximeter (clickhouse-client): inserting 2 new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
2642026-08-19T21:13:33.540ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 280 table_name = fields_i16
2652026-08-19T21:13:33.543ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = fields_ipaddr
2662026-08-19T21:13:33.545ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 773 table_name = fields_string
2672026-08-19T21:13:33.547ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 144 table_name = fields_u16
2682026-08-19T21:13:33.549ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 145 table_name = fields_u32
2692026-08-19T21:13:33.551ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 144 table_name = fields_u8
2702026-08-19T21:13:33.553ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 476 table_name = fields_uuid
2712026-08-19T21:13:33.554ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = measurements_bool
2722026-08-19T21:13:33.556ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 207 table_name = measurements_cumulativeu64
2732026-08-19T21:13:33.558ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 1 table_name = measurements_f64
2742026-08-19T21:13:33.559ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 60 table_name = measurements_u64
2752026-08-19T21:13:33.631ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2762026-08-19T21:13:34.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2772026-08-19T21:13:34.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2782026-08-19T21:13:34.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2792026-08-19T21:13:34.970ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
2802026-08-19T21:13:34.970ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
2812026-08-19T21:13:34.972ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
2822026-08-19T21:13:35.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2832026-08-19T21:13:35.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2842026-08-19T21:13:35.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2852026-08-19T21:13:36.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2862026-08-19T21:13:36.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2872026-08-19T21:13:36.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2882026-08-19T21:13:37.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2892026-08-19T21:13:37.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2902026-08-19T21:13:37.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2912026-08-19T21:13:37.999ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
2922026-08-19T21:13:38.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2932026-08-19T21:13:38.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2942026-08-19T21:13:38.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2952026-08-19T21:13:38.472ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
2962026-08-19T21:13:38.472ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?sort_by=id_ascending
2972026-08-19T21:13:38.504ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "08f415dc-5b0f-41a6-b986-b7665d6f89f2", "content-length": "723", "date": "Wed, 19 Aug 2026 21:13:38 GMT"} })
2982026-08-19T21:13:38.504ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI1ZWYwZTY3ZS02YzRiLTQ5MjMtYmI2MS0yNzliNTRmMzdhNjEifX0%3D
2992026-08-19T21:13:38.515ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI1ZWYwZTY3ZS02YzRiLTQ5MjMtYmI2MS0yNzliNTRmMzdhNjEifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e5ea827-bff0-472b-a318-7a6a4b2080e3", "content-length": "29", "date": "Wed, 19 Aug 2026 21:13:38 GMT"} })
3002026-08-19T21:13:38.515ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:49473 collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff
3012026-08-19T21:13:38.515ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 4 n_pruned_tasks = 0
3022026-08-19T21:13:38.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 143
3032026-08-19T21:13:38.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 143
3042026-08-19T21:13:38.530ZDEBGoximeter (clickhouse-client): unrolling 143 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
3052026-08-19T21:13:38.530ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
3062026-08-19T21:13:38.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = fields_ipaddr
3072026-08-19T21:13:38.537ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 74 table_name = fields_string
3082026-08-19T21:13:38.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 15 table_name = fields_u16
3092026-08-19T21:13:38.540ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 67 table_name = fields_uuid
3102026-08-19T21:13:38.541ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 102 table_name = measurements_cumulativeu64
3112026-08-19T21:13:38.544ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 11 table_name = measurements_histogramu64
3122026-08-19T21:13:38.545ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 30 table_name = measurements_u64
3132026-08-19T21:13:38.631ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
3142026-08-19T21:13:39.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3152026-08-19T21:13:39.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3162026-08-19T21:13:39.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3172026-08-19T21:13:40.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3182026-08-19T21:13:40.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3192026-08-19T21:13:40.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3202026-08-19T21:13:41.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3212026-08-19T21:13:41.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3222026-08-19T21:13:41.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3232026-08-19T21:13:41.642ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
3242026-08-19T21:13:41.642ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
3252026-08-19T21:13:41.650ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
3262026-08-19T21:13:41.820ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
3272026-08-19T21:13:41.820ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
3282026-08-19T21:13:41.826ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 41 producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
3292026-08-19T21:13:42.253ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3302026-08-19T21:13:42.253ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3312026-08-19T21:13:42.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3322026-08-19T21:13:43.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3332026-08-19T21:13:43.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3342026-08-19T21:13:43.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3352026-08-19T21:13:43.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 311
3362026-08-19T21:13:43.530ZDEBGoximeter (clickhouse-client): unrolling 311 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
3372026-08-19T21:13:43.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 311
3382026-08-19T21:13:43.530ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
3392026-08-19T21:13:43.536ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:43.530526084Z } timeseries_name = collection_target:cpus_provisioned
3402026-08-19T21:13:43.536ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:43.530526964Z } timeseries_name = collection_target:ram_provisioned
3412026-08-19T21:13:43.536ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:13:43.530527894Z } timeseries_name = collection_target:virtual_disk_space_provisioned
3422026-08-19T21:13:43.540ZDEBGoximeter (clickhouse-client): inserting 3 new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
3432026-08-19T21:13:43.544ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 280 table_name = fields_i16
3442026-08-19T21:13:43.546ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 817 table_name = fields_string
3452026-08-19T21:13:43.548ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 163 table_name = fields_u16
3462026-08-19T21:13:43.549ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 145 table_name = fields_u32
3472026-08-19T21:13:43.551ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 144 table_name = fields_u8
3482026-08-19T21:13:43.553ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 505 table_name = fields_uuid
3492026-08-19T21:13:43.554ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = measurements_bool
3502026-08-19T21:13:43.556ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 205 table_name = measurements_cumulativeu64
3512026-08-19T21:13:43.558ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 1 table_name = measurements_f64
3522026-08-19T21:13:43.560ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 23 table_name = measurements_histogramu64
3532026-08-19T21:13:43.562ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 18 table_name = measurements_i64
3542026-08-19T21:13:43.564ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 60 table_name = measurements_u64
3552026-08-19T21:13:43.631ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
3562026-08-19T21:13:44.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3572026-08-19T21:13:44.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3582026-08-19T21:13:44.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3592026-08-19T21:13:44.970ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
3602026-08-19T21:13:44.970ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
3612026-08-19T21:13:44.972ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
3622026-08-19T21:13:45.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3632026-08-19T21:13:45.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3642026-08-19T21:13:45.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3652026-08-19T21:13:46.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3662026-08-19T21:13:46.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3672026-08-19T21:13:46.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3682026-08-19T21:13:47.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3692026-08-19T21:13:47.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3702026-08-19T21:13:47.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3712026-08-19T21:13:48.199ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
3722026-08-19T21:13:48.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3732026-08-19T21:13:48.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3742026-08-19T21:13:48.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3752026-08-19T21:13:48.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 143
3762026-08-19T21:13:48.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 143
3772026-08-19T21:13:48.530ZDEBGoximeter (clickhouse-client): unrolling 143 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
3782026-08-19T21:13:48.530ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
3792026-08-19T21:13:48.537ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = fields_ipaddr
3802026-08-19T21:13:48.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 74 table_name = fields_string
3812026-08-19T21:13:48.540ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 15 table_name = fields_u16
3822026-08-19T21:13:48.542ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 67 table_name = fields_uuid
3832026-08-19T21:13:48.544ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 102 table_name = measurements_cumulativeu64
3842026-08-19T21:13:48.546ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 11 table_name = measurements_histogramu64
3852026-08-19T21:13:48.548ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 30 table_name = measurements_u64
3862026-08-19T21:13:48.632ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
3872026-08-19T21:13:49.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3882026-08-19T21:13:49.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3892026-08-19T21:13:49.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3902026-08-19T21:13:50.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3912026-08-19T21:13:50.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3922026-08-19T21:13:50.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3932026-08-19T21:13:51.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3942026-08-19T21:13:51.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3952026-08-19T21:13:51.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3962026-08-19T21:13:51.642ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
3972026-08-19T21:13:51.642ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
3982026-08-19T21:13:51.649ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
3992026-08-19T21:13:51.820ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
4002026-08-19T21:13:51.820ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
4012026-08-19T21:13:51.822ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
4022026-08-19T21:13:52.255ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4032026-08-19T21:13:52.255ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4042026-08-19T21:13:52.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4052026-08-19T21:13:53.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4062026-08-19T21:13:53.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4072026-08-19T21:13:53.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4082026-08-19T21:13:53.472ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
4092026-08-19T21:13:53.472ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?sort_by=id_ascending
4102026-08-19T21:13:53.476ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c274d34-f98b-4793-9e6e-885c4fd645de", "content-length": "723", "date": "Wed, 19 Aug 2026 21:13:53 GMT"} })
4112026-08-19T21:13:53.476ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI1ZWYwZTY3ZS02YzRiLTQ5MjMtYmI2MS0yNzliNTRmMzdhNjEifX0%3D
4122026-08-19T21:13:53.479ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI1ZWYwZTY3ZS02YzRiLTQ5MjMtYmI2MS0yNzliNTRmMzdhNjEifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c4a2960-c23e-415e-9bc8-43928ea99e2a", "content-length": "29", "date": "Wed, 19 Aug 2026 21:13:53 GMT"} })
4132026-08-19T21:13:53.479ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 4 n_pruned_tasks = 0
4142026-08-19T21:13:53.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 297
4152026-08-19T21:13:53.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 297
4162026-08-19T21:13:53.530ZDEBGoximeter (clickhouse-client): unrolling 297 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
4172026-08-19T21:13:53.530ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
4182026-08-19T21:13:53.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 280 table_name = fields_i16
4192026-08-19T21:13:53.541ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = fields_ipaddr
4202026-08-19T21:13:53.543ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 821 table_name = fields_string
4212026-08-19T21:13:53.545ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 167 table_name = fields_u16
4222026-08-19T21:13:53.546ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 145 table_name = fields_u32
4232026-08-19T21:13:53.548ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 144 table_name = fields_u8
4242026-08-19T21:13:53.550ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 499 table_name = fields_uuid
4252026-08-19T21:13:53.551ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = measurements_bool
4262026-08-19T21:13:53.553ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 207 table_name = measurements_cumulativeu64
4272026-08-19T21:13:53.555ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 1 table_name = measurements_f64
4282026-08-19T21:13:53.557ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 25 table_name = measurements_histogramu64
4292026-08-19T21:13:53.559ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 60 table_name = measurements_u64
4302026-08-19T21:13:53.631ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
4312026-08-19T21:13:54.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4322026-08-19T21:13:54.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4332026-08-19T21:13:54.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4342026-08-19T21:13:54.970ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
4352026-08-19T21:13:54.970ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
4362026-08-19T21:13:54.971ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
4372026-08-19T21:13:55.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4382026-08-19T21:13:55.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4392026-08-19T21:13:55.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4402026-08-19T21:13:56.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4412026-08-19T21:13:56.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4422026-08-19T21:13:56.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4432026-08-19T21:13:57.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4442026-08-19T21:13:57.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4452026-08-19T21:13:57.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4462026-08-19T21:13:58.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4472026-08-19T21:13:58.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4482026-08-19T21:13:58.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4492026-08-19T21:13:58.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 141
4502026-08-19T21:13:58.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 141
4512026-08-19T21:13:58.530ZDEBGoximeter (clickhouse-client): unrolling 141 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
4522026-08-19T21:13:58.530ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
4532026-08-19T21:13:58.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 72 table_name = fields_string
4542026-08-19T21:13:58.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 11 table_name = fields_u16
4552026-08-19T21:13:58.542ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 63 table_name = fields_uuid
4562026-08-19T21:13:58.545ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 100 table_name = measurements_cumulativeu64
4572026-08-19T21:13:58.548ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 11 table_name = measurements_histogramu64
4582026-08-19T21:13:58.549ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 30 table_name = measurements_u64
4592026-08-19T21:13:58.631ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
4602026-08-19T21:13:59.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4612026-08-19T21:13:59.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4622026-08-19T21:13:59.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4632026-08-19T21:14:00.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4642026-08-19T21:14:00.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4652026-08-19T21:14:00.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4662026-08-19T21:14:01.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4672026-08-19T21:14:01.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4682026-08-19T21:14:01.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4692026-08-19T21:14:01.642ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
4702026-08-19T21:14:01.642ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
4712026-08-19T21:14:01.650ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
4722026-08-19T21:14:01.820ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
4732026-08-19T21:14:01.820ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
4742026-08-19T21:14:01.822ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
4752026-08-19T21:14:02.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4762026-08-19T21:14:02.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4772026-08-19T21:14:02.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4782026-08-19T21:14:03.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4792026-08-19T21:14:03.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4802026-08-19T21:14:03.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4812026-08-19T21:14:03.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 293
4822026-08-19T21:14:03.530ZDEBGoximeter (clickhouse-client): unrolling 293 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
4832026-08-19T21:14:03.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 293
4842026-08-19T21:14:03.530ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
4852026-08-19T21:14:03.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 280 table_name = fields_i16
4862026-08-19T21:14:03.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 817 table_name = fields_string
4872026-08-19T21:14:03.540ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 163 table_name = fields_u16
4882026-08-19T21:14:03.541ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 145 table_name = fields_u32
4892026-08-19T21:14:03.543ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 144 table_name = fields_u8
4902026-08-19T21:14:03.544ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 495 table_name = fields_uuid
4912026-08-19T21:14:03.545ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = measurements_bool
4922026-08-19T21:14:03.546ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 205 table_name = measurements_cumulativeu64
4932026-08-19T21:14:03.548ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 1 table_name = measurements_f64
4942026-08-19T21:14:03.549ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 23 table_name = measurements_histogramu64
4952026-08-19T21:14:03.550ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 60 table_name = measurements_u64
4962026-08-19T21:14:03.631ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
4972026-08-19T21:14:04.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4982026-08-19T21:14:04.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4992026-08-19T21:14:04.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5002026-08-19T21:14:04.970ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
5012026-08-19T21:14:04.970ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
5022026-08-19T21:14:04.972ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
5032026-08-19T21:14:05.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5042026-08-19T21:14:05.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5052026-08-19T21:14:05.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5062026-08-19T21:14:06.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5072026-08-19T21:14:06.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5082026-08-19T21:14:06.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5092026-08-19T21:14:07.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5102026-08-19T21:14:07.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5112026-08-19T21:14:07.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5122026-08-19T21:14:08.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5132026-08-19T21:14:08.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5142026-08-19T21:14:08.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5152026-08-19T21:14:08.472ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
5162026-08-19T21:14:08.472ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?sort_by=id_ascending
5172026-08-19T21:14:08.487ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "32610632-4f73-4e5b-903a-aa9f0e60650c", "content-length": "999", "date": "Wed, 19 Aug 2026 21:14:08 GMT"} })
5182026-08-19T21:14:08.487ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI1ZWYwZTY3ZS02YzRiLTQ5MjMtYmI2MS0yNzliNTRmMzdhNjEifX0%3D
5192026-08-19T21:14:08.493ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI1ZWYwZTY3ZS02YzRiLTQ5MjMtYmI2MS0yNzliNTRmMzdhNjEifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a43cd6a-d93d-4b65-b777-702d651cf5e3", "content-length": "29", "date": "Wed, 19 Aug 2026 21:14:08 GMT"} })
5202026-08-19T21:14:08.493ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:60076 collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 45dd640c-8534-406a-a0d6-3546b67214ca
5212026-08-19T21:14:08.493ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:46144 collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 569f1ceb-178a-439c-a40f-1ebe574c2c70
5222026-08-19T21:14:08.493ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 6 n_pruned_tasks = 0
5232026-08-19T21:14:08.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 141
5242026-08-19T21:14:08.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 141
5252026-08-19T21:14:08.530ZDEBGoximeter (clickhouse-client): unrolling 141 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
5262026-08-19T21:14:08.530ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
5272026-08-19T21:14:08.534ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 72 table_name = fields_string
5282026-08-19T21:14:08.536ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 11 table_name = fields_u16
5292026-08-19T21:14:08.537ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 63 table_name = fields_uuid
5302026-08-19T21:14:08.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 100 table_name = measurements_cumulativeu64
5312026-08-19T21:14:08.540ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 11 table_name = measurements_histogramu64
5322026-08-19T21:14:08.541ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 30 table_name = measurements_u64
5332026-08-19T21:14:08.631ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
5342026-08-19T21:14:09.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5352026-08-19T21:14:09.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5362026-08-19T21:14:09.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5372026-08-19T21:14:10.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5382026-08-19T21:14:10.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5392026-08-19T21:14:10.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5402026-08-19T21:14:10.376ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 45dd640c-8534-406a-a0d6-3546b67214ca producer_ip = fd00:1122:3344:101::b producer_port = 60076
5412026-08-19T21:14:11.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5422026-08-19T21:14:11.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5432026-08-19T21:14:11.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5442026-08-19T21:14:11.642ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
5452026-08-19T21:14:11.642ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
5462026-08-19T21:14:11.650ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
5472026-08-19T21:14:11.820ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
5482026-08-19T21:14:11.820ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
5492026-08-19T21:14:11.822ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
5502026-08-19T21:14:12.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5512026-08-19T21:14:12.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5522026-08-19T21:14:12.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5532026-08-19T21:14:13.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5542026-08-19T21:14:13.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5552026-08-19T21:14:13.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5562026-08-19T21:14:13.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 295
5572026-08-19T21:14:13.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 295
5582026-08-19T21:14:13.530ZDEBGoximeter (clickhouse-client): unrolling 295 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
5592026-08-19T21:14:13.530ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
5602026-08-19T21:14:13.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 280 table_name = fields_i16
5612026-08-19T21:14:13.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = fields_ipaddr
5622026-08-19T21:14:13.541ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 819 table_name = fields_string
5632026-08-19T21:14:13.542ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 167 table_name = fields_u16
5642026-08-19T21:14:13.544ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 145 table_name = fields_u32
5652026-08-19T21:14:13.545ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 144 table_name = fields_u8
5662026-08-19T21:14:13.546ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 499 table_name = fields_uuid
5672026-08-19T21:14:13.547ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = measurements_bool
5682026-08-19T21:14:13.549ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 207 table_name = measurements_cumulativeu64
5692026-08-19T21:14:13.550ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 1 table_name = measurements_f64
5702026-08-19T21:14:13.552ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 23 table_name = measurements_histogramu64
5712026-08-19T21:14:13.553ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 60 table_name = measurements_u64
5722026-08-19T21:14:13.631ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
5732026-08-19T21:14:14.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5742026-08-19T21:14:14.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5752026-08-19T21:14:14.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5762026-08-19T21:14:14.970ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
5772026-08-19T21:14:14.970ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
5782026-08-19T21:14:14.972ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
5792026-08-19T21:14:15.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5802026-08-19T21:14:15.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5812026-08-19T21:14:15.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5822026-08-19T21:14:16.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5832026-08-19T21:14:16.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5842026-08-19T21:14:16.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5852026-08-19T21:14:16.713ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
5862026-08-19T21:14:16.905ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 45dd640c-8534-406a-a0d6-3546b67214ca producer_ip = fd00:1122:3344:101::b producer_port = 60076
5872026-08-19T21:14:16.905ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 45dd640c-8534-406a-a0d6-3546b67214ca producer_ip = fd00:1122:3344:101::b producer_port = 60076
5882026-08-19T21:14:16.917ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 15 producer_id = 45dd640c-8534-406a-a0d6-3546b67214ca producer_ip = fd00:1122:3344:101::b producer_port = 60076
5892026-08-19T21:14:17.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5902026-08-19T21:14:17.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5912026-08-19T21:14:17.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5922026-08-19T21:14:18.255ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5932026-08-19T21:14:18.255ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5942026-08-19T21:14:18.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5952026-08-19T21:14:18.323ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 569f1ceb-178a-439c-a40f-1ebe574c2c70 producer_ip = fd00:1122:3344:101::a producer_port = 46144
5962026-08-19T21:14:18.323ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 569f1ceb-178a-439c-a40f-1ebe574c2c70 producer_ip = fd00:1122:3344:101::a producer_port = 46144
5972026-08-19T21:14:18.332ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 569f1ceb-178a-439c-a40f-1ebe574c2c70 producer_ip = fd00:1122:3344:101::a producer_port = 46144
5982026-08-19T21:14:18.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 160
5992026-08-19T21:14:18.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 160
6002026-08-19T21:14:18.530ZDEBGoximeter (clickhouse-client): unrolling 160 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
6012026-08-19T21:14:18.530ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
6022026-08-19T21:14:18.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = fields_ipaddr
6032026-08-19T21:14:18.537ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 90 table_name = fields_string
6042026-08-19T21:14:18.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 23 table_name = fields_u16
6052026-08-19T21:14:18.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 84 table_name = fields_uuid
6062026-08-19T21:14:18.540ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 102 table_name = measurements_cumulativeu64
6072026-08-19T21:14:18.542ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 19 table_name = measurements_histogramu64
6082026-08-19T21:14:18.543ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 9 table_name = measurements_i64
6092026-08-19T21:14:18.545ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 30 table_name = measurements_u64
6102026-08-19T21:14:18.631ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
6112026-08-19T21:14:19.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6122026-08-19T21:14:19.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6132026-08-19T21:14:19.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6142026-08-19T21:14:20.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6152026-08-19T21:14:20.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6162026-08-19T21:14:20.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6172026-08-19T21:14:21.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6182026-08-19T21:14:21.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6192026-08-19T21:14:21.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6202026-08-19T21:14:21.643ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
6212026-08-19T21:14:21.643ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
6222026-08-19T21:14:21.650ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
6232026-08-19T21:14:21.820ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
6242026-08-19T21:14:21.820ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
6252026-08-19T21:14:21.822ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
6262026-08-19T21:14:22.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6272026-08-19T21:14:22.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6282026-08-19T21:14:22.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6292026-08-19T21:14:23.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6302026-08-19T21:14:23.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6312026-08-19T21:14:23.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6322026-08-19T21:14:23.472ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
6332026-08-19T21:14:23.472ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?sort_by=id_ascending
6342026-08-19T21:14:23.476ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "b02da4fa-618e-409d-a39f-6eeb271560b4", "content-length": "1140", "date": "Wed, 19 Aug 2026 21:14:23 GMT"} })
6352026-08-19T21:14:23.476ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNGVlMjYxMi02NjM2LTRjZjQtYTI0MS0zNjFlZTZhYzMxZTYifX0%3D
6362026-08-19T21:14:23.479ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNGVlMjYxMi02NjM2LTRjZjQtYTI0MS0zNjFlZTZhYzMxZTYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbb2f27d-a741-4d27-a248-6e53c1fc3759", "content-length": "29", "date": "Wed, 19 Aug 2026 21:14:23 GMT"} })
6372026-08-19T21:14:23.479ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:63940 collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = c4ee2612-6636-4cf4-a241-361ee6ac31e6
6382026-08-19T21:14:23.479ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 7 n_pruned_tasks = 0
6392026-08-19T21:14:23.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 293
6402026-08-19T21:14:23.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 293
6412026-08-19T21:14:23.530ZDEBGoximeter (clickhouse-client): unrolling 293 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
6422026-08-19T21:14:23.530ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
6432026-08-19T21:14:23.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 280 table_name = fields_i16
6442026-08-19T21:14:23.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 817 table_name = fields_string
6452026-08-19T21:14:23.541ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 163 table_name = fields_u16
6462026-08-19T21:14:23.542ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 145 table_name = fields_u32
6472026-08-19T21:14:23.543ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 144 table_name = fields_u8
6482026-08-19T21:14:23.545ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 495 table_name = fields_uuid
6492026-08-19T21:14:23.546ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = measurements_bool
6502026-08-19T21:14:23.548ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 205 table_name = measurements_cumulativeu64
6512026-08-19T21:14:23.549ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 1 table_name = measurements_f64
6522026-08-19T21:14:23.551ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 23 table_name = measurements_histogramu64
6532026-08-19T21:14:23.552ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 60 table_name = measurements_u64
6542026-08-19T21:14:23.631ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
6552026-08-19T21:14:24.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6562026-08-19T21:14:24.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6572026-08-19T21:14:24.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6582026-08-19T21:14:24.970ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
6592026-08-19T21:14:24.970ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
6602026-08-19T21:14:24.971ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
6612026-08-19T21:14:25.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6622026-08-19T21:14:25.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6632026-08-19T21:14:25.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6642026-08-19T21:14:26.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6652026-08-19T21:14:26.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6662026-08-19T21:14:26.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6672026-08-19T21:14:26.905ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 45dd640c-8534-406a-a0d6-3546b67214ca producer_ip = fd00:1122:3344:101::b producer_port = 60076
6682026-08-19T21:14:26.905ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 45dd640c-8534-406a-a0d6-3546b67214ca producer_ip = fd00:1122:3344:101::b producer_port = 60076
6692026-08-19T21:14:26.906ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 6 producer_id = 45dd640c-8534-406a-a0d6-3546b67214ca producer_ip = fd00:1122:3344:101::b producer_port = 60076
6702026-08-19T21:14:27.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6712026-08-19T21:14:27.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6722026-08-19T21:14:27.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6732026-08-19T21:14:28.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6742026-08-19T21:14:28.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6752026-08-19T21:14:28.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6762026-08-19T21:14:28.323ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 569f1ceb-178a-439c-a40f-1ebe574c2c70 producer_ip = fd00:1122:3344:101::a producer_port = 46144
6772026-08-19T21:14:28.323ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 569f1ceb-178a-439c-a40f-1ebe574c2c70 producer_ip = fd00:1122:3344:101::a producer_port = 46144
6782026-08-19T21:14:28.323ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 569f1ceb-178a-439c-a40f-1ebe574c2c70 producer_ip = fd00:1122:3344:101::a producer_port = 46144
6792026-08-19T21:14:28.529ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 149
6802026-08-19T21:14:28.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 149
6812026-08-19T21:14:28.530ZDEBGoximeter (clickhouse-client): unrolling 149 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
6822026-08-19T21:14:28.530ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
6832026-08-19T21:14:28.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 88 table_name = fields_string
6842026-08-19T21:14:28.536ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 19 table_name = fields_u16
6852026-08-19T21:14:28.537ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 71 table_name = fields_uuid
6862026-08-19T21:14:28.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 100 table_name = measurements_cumulativeu64
6872026-08-19T21:14:28.540ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 19 table_name = measurements_histogramu64
6882026-08-19T21:14:28.541ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 30 table_name = measurements_u64
6892026-08-19T21:14:28.631ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
6902026-08-19T21:14:28.752ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6912026-08-19T21:14:29.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6922026-08-19T21:14:29.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6932026-08-19T21:14:29.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6942026-08-19T21:14:30.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6952026-08-19T21:14:30.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6962026-08-19T21:14:30.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6972026-08-19T21:14:31.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6982026-08-19T21:14:31.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6992026-08-19T21:14:31.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7002026-08-19T21:14:31.642ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
7012026-08-19T21:14:31.642ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
7022026-08-19T21:14:31.649ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
7032026-08-19T21:14:31.819ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
7042026-08-19T21:14:31.819ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
7052026-08-19T21:14:31.821ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
7062026-08-19T21:14:32.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7072026-08-19T21:14:32.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7082026-08-19T21:14:32.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7092026-08-19T21:14:33.253ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7102026-08-19T21:14:33.253ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7112026-08-19T21:14:33.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7122026-08-19T21:14:33.529ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 295
7132026-08-19T21:14:33.529ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 295
7142026-08-19T21:14:33.529ZDEBGoximeter (clickhouse-client): unrolling 295 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
7152026-08-19T21:14:33.529ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
7162026-08-19T21:14:33.537ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 280 table_name = fields_i16
7172026-08-19T21:14:33.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = fields_ipaddr
7182026-08-19T21:14:33.540ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 819 table_name = fields_string
7192026-08-19T21:14:33.542ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 167 table_name = fields_u16
7202026-08-19T21:14:33.543ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 145 table_name = fields_u32
7212026-08-19T21:14:33.544ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 144 table_name = fields_u8
7222026-08-19T21:14:33.546ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 499 table_name = fields_uuid
7232026-08-19T21:14:33.547ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = measurements_bool
7242026-08-19T21:14:33.548ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 207 table_name = measurements_cumulativeu64
7252026-08-19T21:14:33.549ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 1 table_name = measurements_f64
7262026-08-19T21:14:33.551ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 23 table_name = measurements_histogramu64
7272026-08-19T21:14:33.552ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 60 table_name = measurements_u64
7282026-08-19T21:14:33.631ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
7292026-08-19T21:14:34.253ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7302026-08-19T21:14:34.253ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7312026-08-19T21:14:34.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7322026-08-19T21:14:34.970ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
7332026-08-19T21:14:34.970ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
7342026-08-19T21:14:34.971ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
7352026-08-19T21:14:35.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7362026-08-19T21:14:35.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7372026-08-19T21:14:35.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7382026-08-19T21:14:36.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7392026-08-19T21:14:36.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7402026-08-19T21:14:36.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7412026-08-19T21:14:36.904ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 45dd640c-8534-406a-a0d6-3546b67214ca producer_ip = fd00:1122:3344:101::b producer_port = 60076
7422026-08-19T21:14:36.904ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 45dd640c-8534-406a-a0d6-3546b67214ca producer_ip = fd00:1122:3344:101::b producer_port = 60076
7432026-08-19T21:14:36.905ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 6 producer_id = 45dd640c-8534-406a-a0d6-3546b67214ca producer_ip = fd00:1122:3344:101::b producer_port = 60076
7442026-08-19T21:14:37.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7452026-08-19T21:14:37.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7462026-08-19T21:14:37.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7472026-08-19T21:14:37.905ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = c4ee2612-6636-4cf4-a241-361ee6ac31e6 producer_ip = fd00:1122:3344:101::1 producer_port = 63940
7482026-08-19T21:14:37.905ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = c4ee2612-6636-4cf4-a241-361ee6ac31e6 producer_ip = fd00:1122:3344:101::1 producer_port = 63940
7492026-08-19T21:14:38.000ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
7502026-08-19T21:14:38.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 10248 producer_id = c4ee2612-6636-4cf4-a241-361ee6ac31e6 producer_ip = fd00:1122:3344:101::1 producer_port = 63940
7512026-08-19T21:14:38.139ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 10371
7522026-08-19T21:14:38.140ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 10371
7532026-08-19T21:14:38.140ZDEBGoximeter (clickhouse-client): unrolling 10371 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
7542026-08-19T21:14:38.142ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
7552026-08-19T21:14:38.144ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("kstat_sampler:expired_targets"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:14:38.142078778Z } timeseries_name = kstat_sampler:expired_targets
7562026-08-19T21:14:38.144ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:in_uft_hits"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:14:38.141112845Z } timeseries_name = opte_port:in_uft_hits
7572026-08-19T21:14:38.144ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:in_uft_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:14:38.141115065Z } timeseries_name = opte_port:in_uft_misses
7582026-08-19T21:14:38.144ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:out_uft_hits"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:14:38.141117235Z } timeseries_name = opte_port:out_uft_hits
7592026-08-19T21:14:38.144ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:out_uft_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:14:38.141119455Z } timeseries_name = opte_port:out_uft_misses
7602026-08-19T21:14:38.144ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_cpu:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "cpu_id", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:14:38.140334327Z } timeseries_name = sled_cpu:cpu_nsec
7612026-08-19T21:14:38.144ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:14:38.141037744Z } timeseries_name = sled_data_link:bytes_received
7622026-08-19T21:14:38.144ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:14:38.141046914Z } timeseries_name = sled_data_link:bytes_sent
7632026-08-19T21:14:38.144ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:14:38.141033413Z } timeseries_name = sled_data_link:errors_received
7642026-08-19T21:14:38.144ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:14:38.141035584Z } timeseries_name = sled_data_link:errors_sent
7652026-08-19T21:14:38.144ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:14:38.141040113Z } timeseries_name = sled_data_link:packets_received
7662026-08-19T21:14:38.144ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:14:38.141048974Z } timeseries_name = sled_data_link:packets_sent
7672026-08-19T21:14:38.144ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_dataset:bytes_used"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "dataset_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "dataset_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "dataset_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:14:38.142094288Z } timeseries_name = zfs_dataset:bytes_used
7682026-08-19T21:14:38.144ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_pool:bytes_allocated"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:14:38.142084818Z } timeseries_name = zfs_pool:bytes_allocated
7692026-08-19T21:14:38.144ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_pool:bytes_total"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:14:38.142086878Z } timeseries_name = zfs_pool:bytes_total
7702026-08-19T21:14:38.144ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("zone:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_type", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:14:38.141502704Z } timeseries_name = zone:cpu_nsec
7712026-08-19T21:14:38.186ZDEBGoximeter (clickhouse-client): inserting 16 new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
7722026-08-19T21:14:38.189ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = fields_ipaddr
7732026-08-19T21:14:38.192ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 3408 table_name = fields_string
7742026-08-19T21:14:38.193ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 29 table_name = fields_u16
7752026-08-19T21:14:38.195ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 977 table_name = fields_u32
7762026-08-19T21:14:38.197ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 1974 table_name = fields_uuid
7772026-08-19T21:14:38.201ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 9714 table_name = measurements_cumulativeu64
7782026-08-19T21:14:38.203ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 25 table_name = measurements_histogramu64
7792026-08-19T21:14:38.204ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 632 table_name = measurements_u64
7802026-08-19T21:14:38.241ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
7812026-08-19T21:14:38.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7822026-08-19T21:14:38.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7832026-08-19T21:14:38.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7842026-08-19T21:14:38.323ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 569f1ceb-178a-439c-a40f-1ebe574c2c70 producer_ip = fd00:1122:3344:101::a producer_port = 46144
7852026-08-19T21:14:38.323ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 569f1ceb-178a-439c-a40f-1ebe574c2c70 producer_ip = fd00:1122:3344:101::a producer_port = 46144
7862026-08-19T21:14:38.324ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 569f1ceb-178a-439c-a40f-1ebe574c2c70 producer_ip = fd00:1122:3344:101::a producer_port = 46144
7872026-08-19T21:14:38.472ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
7882026-08-19T21:14:38.472ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?sort_by=id_ascending
7892026-08-19T21:14:38.476ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "23edd626-f85e-4f2c-96a3-8d8dcfbfc72a", "content-length": "1140", "date": "Wed, 19 Aug 2026 21:14:38 GMT"} })
7902026-08-19T21:14:38.476ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNGVlMjYxMi02NjM2LTRjZjQtYTI0MS0zNjFlZTZhYzMxZTYifX0%3D
7912026-08-19T21:14:38.480ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNGVlMjYxMi02NjM2LTRjZjQtYTI0MS0zNjFlZTZhYzMxZTYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "382b44f3-6af6-4096-8e08-524d69e588cb", "content-length": "29", "date": "Wed, 19 Aug 2026 21:14:38 GMT"} })
7922026-08-19T21:14:38.480ZDEBGoximeter (oximeter-agent): received request to register existing metric producer, updating collection information address = [fd00:1122:3344:101::2]:37579 collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d interval = 30s producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe
7932026-08-19T21:14:38.480ZDEBGoximeter (collection-task-handle): notified collection task of new producer endpoint collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
7942026-08-19T21:14:38.480ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 7 n_pruned_tasks = 0
7952026-08-19T21:14:38.480ZDEBGoximeter (collection-task): collection task received request to update its producer information address = [fd00:1122:3344:101::2]:37579 collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d interval = 30s producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
7962026-08-19T21:14:38.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 28
7972026-08-19T21:14:38.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 28
7982026-08-19T21:14:38.530ZDEBGoximeter (clickhouse-client): unrolling 28 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
7992026-08-19T21:14:38.530ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
8002026-08-19T21:14:38.534ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 54 table_name = fields_string
8012026-08-19T21:14:38.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 2 table_name = fields_u16
8022026-08-19T21:14:38.537ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 54 table_name = fields_uuid
8032026-08-19T21:14:38.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 20 table_name = measurements_cumulativeu64
8042026-08-19T21:14:38.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 2 table_name = measurements_histogramu64
8052026-08-19T21:14:38.540ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 6 table_name = measurements_u64
8062026-08-19T21:14:38.631ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
8072026-08-19T21:14:39.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8082026-08-19T21:14:39.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8092026-08-19T21:14:39.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8102026-08-19T21:14:40.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8112026-08-19T21:14:40.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8122026-08-19T21:14:40.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8132026-08-19T21:14:41.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8142026-08-19T21:14:41.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8152026-08-19T21:14:41.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8162026-08-19T21:14:41.819ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
8172026-08-19T21:14:41.819ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
8182026-08-19T21:14:41.821ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
8192026-08-19T21:14:42.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8202026-08-19T21:14:42.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8212026-08-19T21:14:42.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8222026-08-19T21:14:43.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8232026-08-19T21:14:43.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8242026-08-19T21:14:43.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8252026-08-19T21:14:43.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 153
8262026-08-19T21:14:43.530ZDEBGoximeter (clickhouse-client): unrolling 153 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
8272026-08-19T21:14:43.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 153
8282026-08-19T21:14:43.530ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
8292026-08-19T21:14:43.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 96 table_name = fields_string
8302026-08-19T21:14:43.537ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 23 table_name = fields_u16
8312026-08-19T21:14:43.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 75 table_name = fields_uuid
8322026-08-19T21:14:43.540ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 100 table_name = measurements_cumulativeu64
8332026-08-19T21:14:43.542ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 23 table_name = measurements_histogramu64
8342026-08-19T21:14:43.543ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 30 table_name = measurements_u64
8352026-08-19T21:14:43.631ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
8362026-08-19T21:14:44.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8372026-08-19T21:14:44.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8382026-08-19T21:14:44.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8392026-08-19T21:14:44.970ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
8402026-08-19T21:14:44.971ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
8412026-08-19T21:14:44.971ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
8422026-08-19T21:14:45.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8432026-08-19T21:14:45.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8442026-08-19T21:14:45.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8452026-08-19T21:14:46.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8462026-08-19T21:14:46.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8472026-08-19T21:14:46.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8482026-08-19T21:14:46.905ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 45dd640c-8534-406a-a0d6-3546b67214ca producer_ip = fd00:1122:3344:101::b producer_port = 60076
8492026-08-19T21:14:46.905ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 45dd640c-8534-406a-a0d6-3546b67214ca producer_ip = fd00:1122:3344:101::b producer_port = 60076
8502026-08-19T21:14:46.906ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 6 producer_id = 45dd640c-8534-406a-a0d6-3546b67214ca producer_ip = fd00:1122:3344:101::b producer_port = 60076
8512026-08-19T21:14:47.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8522026-08-19T21:14:47.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8532026-08-19T21:14:47.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8542026-08-19T21:14:48.199ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
8552026-08-19T21:14:48.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8562026-08-19T21:14:48.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8572026-08-19T21:14:48.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8582026-08-19T21:14:48.323ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 569f1ceb-178a-439c-a40f-1ebe574c2c70 producer_ip = fd00:1122:3344:101::a producer_port = 46144
8592026-08-19T21:14:48.323ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 569f1ceb-178a-439c-a40f-1ebe574c2c70 producer_ip = fd00:1122:3344:101::a producer_port = 46144
8602026-08-19T21:14:48.324ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 569f1ceb-178a-439c-a40f-1ebe574c2c70 producer_ip = fd00:1122:3344:101::a producer_port = 46144
8612026-08-19T21:14:48.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 151
8622026-08-19T21:14:48.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 151
8632026-08-19T21:14:48.530ZDEBGoximeter (clickhouse-client): unrolling 151 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
8642026-08-19T21:14:48.530ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
8652026-08-19T21:14:48.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = fields_ipaddr
8662026-08-19T21:14:48.537ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 90 table_name = fields_string
8672026-08-19T21:14:48.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 23 table_name = fields_u16
8682026-08-19T21:14:48.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 75 table_name = fields_uuid
8692026-08-19T21:14:48.541ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 102 table_name = measurements_cumulativeu64
8702026-08-19T21:14:48.543ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 19 table_name = measurements_histogramu64
8712026-08-19T21:14:48.544ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 30 table_name = measurements_u64
8722026-08-19T21:14:48.631ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
8732026-08-19T21:14:49.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8742026-08-19T21:14:49.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8752026-08-19T21:14:49.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8762026-08-19T21:14:50.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8772026-08-19T21:14:50.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8782026-08-19T21:14:50.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8792026-08-19T21:14:51.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8802026-08-19T21:14:51.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8812026-08-19T21:14:51.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8822026-08-19T21:14:51.820ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
8832026-08-19T21:14:51.820ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
8842026-08-19T21:14:51.823ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
8852026-08-19T21:14:52.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8862026-08-19T21:14:52.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8872026-08-19T21:14:52.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8882026-08-19T21:14:53.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8892026-08-19T21:14:53.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8902026-08-19T21:14:53.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8912026-08-19T21:14:53.472ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
8922026-08-19T21:14:53.472ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?sort_by=id_ascending
8932026-08-19T21:14:53.477ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "f79c30d3-4288-43cd-bd53-7f00210c4459", "content-length": "1412", "date": "Wed, 19 Aug 2026 21:14:53 GMT"} })
8942026-08-19T21:14:53.477ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNGVlMjYxMi02NjM2LTRjZjQtYTI0MS0zNjFlZTZhYzMxZTYifX0%3D
8952026-08-19T21:14:53.480ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/5dceac3a-cd82-4fea-877e-db974700937c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNGVlMjYxMi02NjM2LTRjZjQtYTI0MS0zNjFlZTZhYzMxZTYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "e913c1c9-8d25-4bbd-b134-9d829853b4ac", "content-length": "29", "date": "Wed, 19 Aug 2026 21:14:53 GMT"} })
8962026-08-19T21:14:53.480ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d
8972026-08-19T21:14:53.480ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a
8982026-08-19T21:14:53.481ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 9 n_pruned_tasks = 0
8992026-08-19T21:14:53.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 157
9002026-08-19T21:14:53.530ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 157
9012026-08-19T21:14:53.530ZDEBGoximeter (clickhouse-client): unrolling 157 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
9022026-08-19T21:14:53.530ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
9032026-08-19T21:14:53.535ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = fields_ipaddr
9042026-08-19T21:14:53.537ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 100 table_name = fields_string
9052026-08-19T21:14:53.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 27 table_name = fields_u16
9062026-08-19T21:14:53.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 79 table_name = fields_uuid
9072026-08-19T21:14:53.540ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 102 table_name = measurements_cumulativeu64
9082026-08-19T21:14:53.542ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 25 table_name = measurements_histogramu64
9092026-08-19T21:14:53.543ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 30 table_name = measurements_u64
9102026-08-19T21:14:53.570ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9112026-08-19T21:14:53.570ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9122026-08-19T21:14:53.577ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9132026-08-19T21:14:53.631ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
9142026-08-19T21:14:53.783ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 569f1ceb-178a-439c-a40f-1ebe574c2c70 producer_ip = fd00:1122:3344:101::a producer_port = 46144
9152026-08-19T21:14:54.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9162026-08-19T21:14:54.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9172026-08-19T21:14:54.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9182026-08-19T21:14:54.475ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9192026-08-19T21:14:54.476ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9202026-08-19T21:14:54.482ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9212026-08-19T21:14:54.570ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9222026-08-19T21:14:54.570ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9232026-08-19T21:14:54.572ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9242026-08-19T21:14:54.970ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
9252026-08-19T21:14:54.970ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
9262026-08-19T21:14:54.971ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 5ef0e67e-6c4b-4923-bb61-279b54f37a61 producer_ip = fd00:1122:3344:101::2 producer_port = 46255
9272026-08-19T21:14:55.253ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9282026-08-19T21:14:55.253ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9292026-08-19T21:14:55.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9302026-08-19T21:14:55.476ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9312026-08-19T21:14:55.476ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9322026-08-19T21:14:55.477ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9332026-08-19T21:14:55.570ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9342026-08-19T21:14:55.570ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9352026-08-19T21:14:55.571ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9362026-08-19T21:14:56.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9372026-08-19T21:14:56.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9382026-08-19T21:14:56.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9392026-08-19T21:14:56.476ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9402026-08-19T21:14:56.476ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9412026-08-19T21:14:56.476ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9422026-08-19T21:14:56.569ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9432026-08-19T21:14:56.569ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9442026-08-19T21:14:56.571ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9452026-08-19T21:14:56.905ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 45dd640c-8534-406a-a0d6-3546b67214ca producer_ip = fd00:1122:3344:101::b producer_port = 60076
9462026-08-19T21:14:56.905ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 45dd640c-8534-406a-a0d6-3546b67214ca producer_ip = fd00:1122:3344:101::b producer_port = 60076
9472026-08-19T21:14:56.906ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 6 producer_id = 45dd640c-8534-406a-a0d6-3546b67214ca producer_ip = fd00:1122:3344:101::b producer_port = 60076
9482026-08-19T21:14:57.253ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9492026-08-19T21:14:57.253ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9502026-08-19T21:14:57.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9512026-08-19T21:14:57.475ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9522026-08-19T21:14:57.475ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9532026-08-19T21:14:57.476ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9542026-08-19T21:14:57.570ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9552026-08-19T21:14:57.570ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9562026-08-19T21:14:57.571ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9572026-08-19T21:14:58.253ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9582026-08-19T21:14:58.253ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9592026-08-19T21:14:58.255ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9602026-08-19T21:14:58.323ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 569f1ceb-178a-439c-a40f-1ebe574c2c70 producer_ip = fd00:1122:3344:101::a producer_port = 46144
9612026-08-19T21:14:58.323ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 569f1ceb-178a-439c-a40f-1ebe574c2c70 producer_ip = fd00:1122:3344:101::a producer_port = 46144
9622026-08-19T21:14:58.323ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 569f1ceb-178a-439c-a40f-1ebe574c2c70 producer_ip = fd00:1122:3344:101::a producer_port = 46144
9632026-08-19T21:14:58.476ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9642026-08-19T21:14:58.476ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9652026-08-19T21:14:58.476ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9662026-08-19T21:14:58.529ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 241
9672026-08-19T21:14:58.529ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_samples = 241
9682026-08-19T21:14:58.529ZDEBGoximeter (clickhouse-client): unrolling 241 total samples collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
9692026-08-19T21:14:58.529ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
9702026-08-19T21:14:58.532ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:14:58.529779181Z } timeseries_name = mg_lower:routes_blocked_by_link_state
9712026-08-19T21:14:58.532ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:14:58.529776861Z } timeseries_name = static_routing_config:static_nexthops
9722026-08-19T21:14:58.532ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:14:58.529775771Z } timeseries_name = static_routing_config:static_routes
9732026-08-19T21:14:58.532ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-08-19T21:14:58.529777971Z } timeseries_name = switch_rib:active_routes
9742026-08-19T21:14:58.533ZDEBGoximeter (clickhouse-client): inserting 4 new timeseries schema collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba
9752026-08-19T21:14:58.537ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 4 table_name = fields_ipaddr
9762026-08-19T21:14:58.538ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 120 table_name = fields_string
9772026-08-19T21:14:58.539ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 23 table_name = fields_u16
9782026-08-19T21:14:58.541ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 111 table_name = fields_uuid
9792026-08-19T21:14:58.542ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 162 table_name = measurements_cumulativeu64
9802026-08-19T21:14:58.544ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 19 table_name = measurements_histogramu64
9812026-08-19T21:14:58.545ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d id = d8a68822-dedf-4396-8e13-88cc820cfcba n_rows = 60 table_name = measurements_u64
9822026-08-19T21:14:58.570ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9832026-08-19T21:14:58.570ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9842026-08-19T21:14:58.571ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9852026-08-19T21:14:58.631ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
9862026-08-19T21:14:59.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9872026-08-19T21:14:59.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9882026-08-19T21:14:59.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9892026-08-19T21:14:59.391ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
9902026-08-19T21:14:59.391ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
9912026-08-19T21:14:59.412ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 456 producer_id = 055cf6bd-b9e5-4c0a-b7cd-7eb82209b2fe producer_ip = fd00:1122:3344:101::2 producer_port = 33301
9922026-08-19T21:14:59.476ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9932026-08-19T21:14:59.476ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9942026-08-19T21:14:59.477ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9952026-08-19T21:14:59.570ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9962026-08-19T21:14:59.570ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9972026-08-19T21:14:59.571ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9982026-08-19T21:15:00.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9992026-08-19T21:15:00.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10002026-08-19T21:15:00.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10012026-08-19T21:15:00.476ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10022026-08-19T21:15:00.476ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10032026-08-19T21:15:00.477ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10042026-08-19T21:15:00.570ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10052026-08-19T21:15:00.570ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10062026-08-19T21:15:00.571ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10072026-08-19T21:15:01.253ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10082026-08-19T21:15:01.253ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10092026-08-19T21:15:01.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10102026-08-19T21:15:01.476ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10112026-08-19T21:15:01.476ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10122026-08-19T21:15:01.476ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10132026-08-19T21:15:01.570ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10142026-08-19T21:15:01.570ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10152026-08-19T21:15:01.571ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10162026-08-19T21:15:01.820ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
10172026-08-19T21:15:01.820ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
10182026-08-19T21:15:01.822ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 3c52f70f-80c7-45af-8ad8-b3b54c9868ff producer_ip = fd00:1122:3344:101::c producer_port = 49473
10192026-08-19T21:15:02.254ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10202026-08-19T21:15:02.254ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10212026-08-19T21:15:02.256ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 233238fb-fc56-4cf6-aa73-d031bc7d2498 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10222026-08-19T21:15:02.476ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10232026-08-19T21:15:02.476ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10242026-08-19T21:15:02.476ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 2105a3ee-a636-4a58-bdfa-170d3e911c8d producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10252026-08-19T21:15:02.570ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10262026-08-19T21:15:02.570ZDEBGoximeter (collection-task): collecting from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10272026-08-19T21:15:02.571ZDEBGoximeter (collection-task): collected results from producer collector_id = 5dceac3a-cd82-4fea-877e-db974700937c collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 739ba3b4-9a57-41c7-8e4c-a707ad2ac51a producer_ip = fd00:1122:3344:101::2 producer_port = 8001