Max level shown:
1 [ Jul 17 01:57:43 Enabled. ]
2 [ Jul 17 01:57:43 Rereading configuration. ]
3 [ Jul 17 01:57:43 Rereading configuration. ]
4 [ Jul 17 01:57:47 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e &"). ]
5 [ Jul 17 01:57:47 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-07-17T01:57:47.276ZDEBGoximeter: registered DTrace probes
82026-07-17T01:57:47.277ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:299
92026-07-17T01:57:47.280ZDEBGoximeter: creating ClickHouse client
102026-07-17T01:57:47.321ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
112026-07-17T01:57:53.458ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:888 id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
122026-07-17T01:57:53.458ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d
132026-07-17T01:57:53.458ZINFOoximeter (clickhouse-client): reading db version collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:788 id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
142026-07-17T01:57:53.459ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:888 id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
152026-07-17T01:57:53.459ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:793 id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 version = 0
162026-07-17T01:57:53.459ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:798 id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
172026-07-17T01:57:53.459ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
182026-07-17T01:57:53.573ZINFOoximeter (clickhouse-client): inserting current version collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:819 id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 version = 14
192026-07-17T01:57:53.615ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = f79c359a-d698-409c-9656-ba0ddfbf36af
202026-07-17T01:57:53.631ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-07-17T01:57:53.631ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-07-17T01:57:53.631ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-07-17T01:57:53.631ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-07-17T01:57:53.631ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:335 local_addr = [fd00:1122:3344:101::d]:12223
252026-07-17T01:57:53.641ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-07-17T01:57:53.641ZDEBGoximeter: registered USDT probes
272026-07-17T01:57:53.642ZDEBGoximeter: contacting nexus
282026-07-17T01:57:53.688ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
292026-07-17T01:57:53.689ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
302026-07-17T01:57:53.689ZWARNoximeter: failed to contact nexus, will retry in 302.606334ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:444
312026-07-17T01:57:53.993ZDEBGoximeter: contacting nexus
322026-07-17T01:57:53.993ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
332026-07-17T01:57:53.994ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
342026-07-17T01:57:53.994ZWARNoximeter: failed to contact nexus, will retry in 563.116752ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:444
352026-07-17T01:57:54.558ZDEBGoximeter: contacting nexus
362026-07-17T01:57:54.558ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
372026-07-17T01:57:54.558ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
382026-07-17T01:57:54.558ZWARNoximeter: failed to contact nexus, will retry in 518.559445ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:444
392026-07-17T01:57:55.078ZDEBGoximeter: contacting nexus
402026-07-17T01:57:55.078ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
412026-07-17T01:57:55.078ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
422026-07-17T01:57:55.079ZWARNoximeter: failed to contact nexus, will retry in 2.182650315s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:444
432026-07-17T01:57:57.263ZDEBGoximeter: contacting nexus
442026-07-17T01:57:57.263ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
452026-07-17T01:57:57.325ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "cd0234b1-75c1-4f11-960d-a45b9c014041", "date": "Fri, 17 Jul 2026 01:57:57 GMT"} })
462026-07-17T01:57:57.325ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:462 id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e
472026-07-17T01:57:57.325ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:631
482026-07-17T01:57:57.326ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:634
492026-07-17T01:57:57.333ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?sort_by=id_ascending
502026-07-17T01:57:57.370ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "6870f806-e622-4870-ac2e-731b1a380253", "content-length": "29", "date": "Fri, 17 Jul 2026 01:57:57 GMT"} })
512026-07-17T01:57:57.370ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:709 n_current_tasks = 0 n_pruned_tasks = 0
522026-07-17T01:57:58.616ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 4
532026-07-17T01:57:58.616ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 4
542026-07-17T01:57:58.616ZDEBGoximeter (clickhouse-client): unrolling 4 total samples collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
552026-07-17T01:57:58.626ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
562026-07-17T01:57:58.630ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:database_queue_depth"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "collector_sink", field_type: String, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:57:58.626576650Z } timeseries_name = oximeter_collector:database_queue_depth
572026-07-17T01:57:58.630ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:database_samples_dropped"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "collector_sink", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:57:58.626567030Z } timeseries_name = oximeter_collector:database_samples_dropped
582026-07-17T01:57:58.636ZDEBGoximeter (clickhouse-client): inserting 2 new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
592026-07-17T01:57:58.641ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 4 table_name = fields_ipaddr
602026-07-17T01:57:58.643ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 4 table_name = fields_string
612026-07-17T01:57:58.647ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 4 table_name = fields_u16
622026-07-17T01:57:58.650ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 4 table_name = fields_uuid
632026-07-17T01:57:58.652ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 2 table_name = measurements_cumulativeu64
642026-07-17T01:57:58.656ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 2 table_name = measurements_histogramu64
652026-07-17T01:57:58.719ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
662026-07-17T01:58:03.616ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d
672026-07-17T01:58:03.616ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d
682026-07-17T01:58:08.617ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d
692026-07-17T01:58:08.617ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d
702026-07-17T01:58:12.327ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:634
712026-07-17T01:58:12.327ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?sort_by=id_ascending
722026-07-17T01:58:12.341ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d2d9bf9-6b39-4403-98a4-90e7b4b9df21", "content-length": "441", "date": "Fri, 17 Jul 2026 01:58:12 GMT"} })
732026-07-17T01:58:12.346ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDZiMTIyMC1jNzk3LTQwNTYtYjBkYS0zNWZiMTZlOGQxYzUifX0%3D
742026-07-17T01:58:12.374ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDZiMTIyMC1jNzk3LTQwNTYtYjBkYS0zNWZiMTZlOGQxYzUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3ccb4dd-cae2-46c8-b169-2d70f456a7a3", "content-length": "29", "date": "Fri, 17 Jul 2026 01:58:12 GMT"} })
752026-07-17T01:58:12.374ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:57735 collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21
762026-07-17T01:58:12.376ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:42412 collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = fd6b1220-c797-4056-b0da-35fb16e8d1c5
772026-07-17T01:58:12.376ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:709 n_current_tasks = 2 n_pruned_tasks = 0
782026-07-17T01:58:13.616ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d
792026-07-17T01:58:13.616ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d
802026-07-17T01:58:18.616ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d
812026-07-17T01:58:18.616ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d
822026-07-17T01:58:19.290ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
832026-07-17T01:58:19.290ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
842026-07-17T01:58:19.330ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 324 producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
852026-07-17T01:58:23.616ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 324
862026-07-17T01:58:23.616ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 324
872026-07-17T01:58:23.616ZDEBGoximeter (clickhouse-client): unrolling 324 total samples collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
882026-07-17T01:58:23.616ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
892026-07-17T01:58:23.622ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:23.616589199Z } timeseries_name = switch_port_control_data_link:bytes_received
902026-07-17T01:58:23.622ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:23.616597509Z } timeseries_name = switch_port_control_data_link:bytes_sent
912026-07-17T01:58:23.622ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:23.616577528Z } timeseries_name = switch_port_control_data_link:errors_received
922026-07-17T01:58:23.622ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:23.616583599Z } timeseries_name = switch_port_control_data_link:errors_sent
932026-07-17T01:58:23.622ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:23.616593919Z } timeseries_name = switch_port_control_data_link:packets_received
942026-07-17T01:58:23.622ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:23.616602349Z } timeseries_name = switch_port_control_data_link:packets_sent
952026-07-17T01:58:23.634ZDEBGoximeter (clickhouse-client): inserting 6 new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
962026-07-17T01:58:23.641ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 24 table_name = fields_i16
972026-07-17T01:58:23.643ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 120 table_name = fields_string
982026-07-17T01:58:23.644ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 12 table_name = fields_u16
992026-07-17T01:58:23.645ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 24 table_name = fields_u32
1002026-07-17T01:58:23.647ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 12 table_name = fields_u8
1012026-07-17T01:58:23.649ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 36 table_name = fields_uuid
1022026-07-17T01:58:23.652ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 324 table_name = measurements_cumulativeu64
1032026-07-17T01:58:23.718ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1042026-07-17T01:58:27.327ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:634
1052026-07-17T01:58:27.327ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?sort_by=id_ascending
1062026-07-17T01:58:27.376ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "282739cc-e3a7-48fd-8219-1a73def92c6d", "content-length": "579", "date": "Fri, 17 Jul 2026 01:58:27 GMT"} })
1072026-07-17T01:58:27.376ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDZiMTIyMC1jNzk3LTQwNTYtYjBkYS0zNWZiMTZlOGQxYzUifX0%3D
1082026-07-17T01:58:27.386ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDZiMTIyMC1jNzk3LTQwNTYtYjBkYS0zNWZiMTZlOGQxYzUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "53e7063e-05eb-4937-a729-46d41013aff5", "content-length": "29", "date": "Fri, 17 Jul 2026 01:58:27 GMT"} })
1092026-07-17T01:58:27.386ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:44729 collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565
1102026-07-17T01:58:27.386ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:709 n_current_tasks = 3 n_pruned_tasks = 0
1112026-07-17T01:58:28.617ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d
1122026-07-17T01:58:28.617ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d
1132026-07-17T01:58:28.747ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
1142026-07-17T01:58:28.747ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
1152026-07-17T01:58:28.761ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 14 producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
1162026-07-17T01:58:31.729ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = fd6b1220-c797-4056-b0da-35fb16e8d1c5 producer_ip = fd00:1122:3344:101::1 producer_port = 42412
1172026-07-17T01:58:31.729ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = fd6b1220-c797-4056-b0da-35fb16e8d1c5 producer_ip = fd00:1122:3344:101::1 producer_port = 42412
1182026-07-17T01:58:31.849ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 5535 producer_id = fd6b1220-c797-4056-b0da-35fb16e8d1c5 producer_ip = fd00:1122:3344:101::1 producer_port = 42412
1192026-07-17T01:58:31.880ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 5549
1202026-07-17T01:58:31.880ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 5549
1212026-07-17T01:58:31.880ZDEBGoximeter (clickhouse-client): unrolling 5549 total samples collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
1222026-07-17T01:58:31.881ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
1232026-07-17T01:58:31.883ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:31.880234203Z } timeseries_name = collection_target:cpus_provisioned
1242026-07-17T01:58:31.883ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:31.880236153Z } timeseries_name = collection_target:ram_provisioned
1252026-07-17T01:58:31.883ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:31.880237193Z } timeseries_name = collection_target:virtual_disk_space_provisioned
1262026-07-17T01:58:31.883ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:31.880219823Z } timeseries_name = http_service:request_latency_histogram
1272026-07-17T01:58:31.883ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("kstat_sampler:expired_targets"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:31.881002427Z } timeseries_name = kstat_sampler:expired_targets
1282026-07-17T01:58:31.883ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_cpu:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "cpu_id", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:31.880370734Z } timeseries_name = sled_cpu:cpu_nsec
1292026-07-17T01:58:31.883ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:31.880245303Z } timeseries_name = sled_data_link:bytes_received
1302026-07-17T01:58:31.883ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:31.880249683Z } timeseries_name = sled_data_link:bytes_sent
1312026-07-17T01:58:31.883ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:31.880240933Z } timeseries_name = sled_data_link:errors_received
1322026-07-17T01:58:31.883ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:31.880243543Z } timeseries_name = sled_data_link:errors_sent
1332026-07-17T01:58:31.883ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:31.880247573Z } timeseries_name = sled_data_link:packets_received
1342026-07-17T01:58:31.883ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:31.880251613Z } timeseries_name = sled_data_link:packets_sent
1352026-07-17T01:58:31.883ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_dataset:bytes_used"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "dataset_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "dataset_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "dataset_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:31.881018937Z } timeseries_name = zfs_dataset:bytes_used
1362026-07-17T01:58:31.883ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_pool:bytes_allocated"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:31.881008167Z } timeseries_name = zfs_pool:bytes_allocated
1372026-07-17T01:58:31.883ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_pool:bytes_total"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:31.881011147Z } timeseries_name = zfs_pool:bytes_total
1382026-07-17T01:58:31.883ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zone:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_type", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:31.880799406Z } timeseries_name = zone:cpu_nsec
1392026-07-17T01:58:31.909ZDEBGoximeter (clickhouse-client): inserting 16 new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
1402026-07-17T01:58:31.914ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 3218 table_name = fields_string
1412026-07-17T01:58:31.915ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 16 table_name = fields_u16
1422026-07-17T01:58:31.917ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 953 table_name = fields_u32
1432026-07-17T01:58:31.919ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 1819 table_name = fields_uuid
1442026-07-17T01:58:31.921ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 5071 table_name = measurements_cumulativeu64
1452026-07-17T01:58:31.925ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 16 table_name = measurements_histogramu64
1462026-07-17T01:58:31.926ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 6 table_name = measurements_i64
1472026-07-17T01:58:31.927ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 456 table_name = measurements_u64
1482026-07-17T01:58:31.981ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1492026-07-17T01:58:33.617ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d
1502026-07-17T01:58:33.617ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d
1512026-07-17T01:58:38.617ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d
1522026-07-17T01:58:38.617ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d
1532026-07-17T01:58:38.747ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
1542026-07-17T01:58:38.747ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
1552026-07-17T01:58:38.749ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 38 producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
1562026-07-17T01:58:42.327ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:634
1572026-07-17T01:58:42.327ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?sort_by=id_ascending
1582026-07-17T01:58:42.332ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "f906f253-1325-4e53-a773-84a974f67709", "content-length": "579", "date": "Fri, 17 Jul 2026 01:58:42 GMT"} })
1592026-07-17T01:58:42.332ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDZiMTIyMC1jNzk3LTQwNTYtYjBkYS0zNWZiMTZlOGQxYzUifX0%3D
1602026-07-17T01:58:42.339ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDZiMTIyMC1jNzk3LTQwNTYtYjBkYS0zNWZiMTZlOGQxYzUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "c50f5d64-44ba-4282-9e91-daa485cba8d9", "content-length": "29", "date": "Fri, 17 Jul 2026 01:58:42 GMT"} })
1612026-07-17T01:58:42.339ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:709 n_current_tasks = 3 n_pruned_tasks = 0
1622026-07-17T01:58:43.617ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 38
1632026-07-17T01:58:43.617ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 38
1642026-07-17T01:58:43.617ZDEBGoximeter (clickhouse-client): unrolling 38 total samples collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
1652026-07-17T01:58:43.617ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
1662026-07-17T01:58:43.648ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 46 table_name = fields_string
1672026-07-17T01:58:43.650ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 23 table_name = fields_u16
1682026-07-17T01:58:43.651ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 31 table_name = fields_uuid
1692026-07-17T01:58:43.653ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 23 table_name = measurements_histogramu64
1702026-07-17T01:58:43.654ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 15 table_name = measurements_i64
1712026-07-17T01:58:43.718ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1722026-07-17T01:58:45.553ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
1732026-07-17T01:58:47.381ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
1742026-07-17T01:58:48.616ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 4
1752026-07-17T01:58:48.616ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 4
1762026-07-17T01:58:48.616ZDEBGoximeter (clickhouse-client): unrolling 4 total samples collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
1772026-07-17T01:58:48.616ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
1782026-07-17T01:58:48.618ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:48.616924625Z } timeseries_name = oximeter_collector:collections
1792026-07-17T01:58:48.618ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:samples_collected"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:48.616928665Z } timeseries_name = oximeter_collector:samples_collected
1802026-07-17T01:58:48.618ZDEBGoximeter (clickhouse-client): inserting 2 new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
1812026-07-17T01:58:48.621ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 8 table_name = fields_ipaddr
1822026-07-17T01:58:48.623ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 4 table_name = fields_string
1832026-07-17T01:58:48.624ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 8 table_name = fields_u16
1842026-07-17T01:58:48.625ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 8 table_name = fields_uuid
1852026-07-17T01:58:48.626ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 4 table_name = measurements_cumulativeu64
1862026-07-17T01:58:48.717ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1872026-07-17T01:58:48.746ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
1882026-07-17T01:58:48.746ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
1892026-07-17T01:58:48.749ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
1902026-07-17T01:58:49.291ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
1912026-07-17T01:58:49.291ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
1922026-07-17T01:58:49.292ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 36 producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
1932026-07-17T01:58:53.617ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 59
1942026-07-17T01:58:53.617ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 59
1952026-07-17T01:58:53.617ZDEBGoximeter (clickhouse-client): unrolling 59 total samples collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
1962026-07-17T01:58:53.617ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
1972026-07-17T01:58:53.627ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 24 table_name = fields_i16
1982026-07-17T01:58:53.628ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 166 table_name = fields_string
1992026-07-17T01:58:53.630ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 35 table_name = fields_u16
2002026-07-17T01:58:53.631ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 24 table_name = fields_u32
2012026-07-17T01:58:53.632ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 12 table_name = fields_u8
2022026-07-17T01:58:53.633ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 59 table_name = fields_uuid
2032026-07-17T01:58:53.635ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 36 table_name = measurements_cumulativeu64
2042026-07-17T01:58:53.637ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 23 table_name = measurements_histogramu64
2052026-07-17T01:58:53.719ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2062026-07-17T01:58:57.326ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:634
2072026-07-17T01:58:57.327ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?sort_by=id_ascending
2082026-07-17T01:58:57.330ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbec4de6-f3be-429e-9bbb-a3ea71f6a0f8", "content-length": "715", "date": "Fri, 17 Jul 2026 01:58:57 GMT"} })
2092026-07-17T01:58:57.330ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDZiMTIyMC1jNzk3LTQwNTYtYjBkYS0zNWZiMTZlOGQxYzUifX0%3D
2102026-07-17T01:58:57.333ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDZiMTIyMC1jNzk3LTQwNTYtYjBkYS0zNWZiMTZlOGQxYzUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "30a60afd-f7e7-4fc9-8f18-fc43f1c2bf75", "content-length": "29", "date": "Fri, 17 Jul 2026 01:58:57 GMT"} })
2112026-07-17T01:58:57.333ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad
2122026-07-17T01:58:57.333ZDEBGoximeter (oximeter-agent): received request to register existing metric producer, updating collection information address = [fd00:1122:3344:101::2]:34285 collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21
2132026-07-17T01:58:57.333ZDEBGoximeter (collection-task-handle): notified collection task of new producer endpoint collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
2142026-07-17T01:58:57.333ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:709 n_current_tasks = 4 n_pruned_tasks = 0
2152026-07-17T01:58:57.333ZDEBGoximeter (collection-task): collection task received request to update its producer information address = [fd00:1122:3344:101::2]:34285 collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
2162026-07-17T01:58:57.730ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
2172026-07-17T01:58:57.730ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
2182026-07-17T01:58:57.747ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
2192026-07-17T01:58:57.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2202026-07-17T01:58:57.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2212026-07-17T01:58:57.767ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2222026-07-17T01:58:58.617ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 170
2232026-07-17T01:58:58.617ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 170
2242026-07-17T01:58:58.617ZDEBGoximeter (clickhouse-client): unrolling 170 total samples collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
2252026-07-17T01:58:58.617ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
2262026-07-17T01:58:58.620ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617559457Z } timeseries_name = ddm_router:originated_tunnel_endpoints
2272026-07-17T01:58:58.620ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617557887Z } timeseries_name = ddm_router:originated_underlay_prefixes
2282026-07-17T01:58:58.620ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617566887Z } timeseries_name = ddm_session:advertisements_received
2292026-07-17T01:58:58.620ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617564667Z } timeseries_name = ddm_session:advertisements_sent
2302026-07-17T01:58:58.620ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617579877Z } timeseries_name = ddm_session:imported_tunnel_endpoints
2312026-07-17T01:58:58.620ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617578337Z } timeseries_name = ddm_session:imported_underlay_prefixes
2322026-07-17T01:58:58.620ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617570277Z } timeseries_name = ddm_session:peer_address_changes
2332026-07-17T01:58:58.620ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617568577Z } timeseries_name = ddm_session:peer_expirations
2342026-07-17T01:58:58.620ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617572447Z } timeseries_name = ddm_session:peer_sessions_established
2352026-07-17T01:58:58.620ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617563047Z } timeseries_name = ddm_session:solicitations_received
2362026-07-17T01:58:58.620ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617561247Z } timeseries_name = ddm_session:solicitations_sent
2372026-07-17T01:58:58.620ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617576797Z } timeseries_name = ddm_session:update_send_fail
2382026-07-17T01:58:58.620ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617575088Z } timeseries_name = ddm_session:updates_received
2392026-07-17T01:58:58.620ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617573747Z } timeseries_name = ddm_session:updates_sent
2402026-07-17T01:58:58.620ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617555987Z } timeseries_name = dendrite:sample_collection_duration
2412026-07-17T01:58:58.621ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617478267Z } timeseries_name = switch_data_link:link_enabled
2422026-07-17T01:58:58.621ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617484457Z } timeseries_name = switch_data_link:link_up
2432026-07-17T01:58:58.621ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617490367Z } timeseries_name = switch_table:capacity
2442026-07-17T01:58:58.621ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617507137Z } timeseries_name = switch_table:collisions
2452026-07-17T01:58:58.621ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617513697Z } timeseries_name = switch_table:delete_misses
2462026-07-17T01:58:58.621ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617500547Z } timeseries_name = switch_table:deletes
2472026-07-17T01:58:58.621ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617525017Z } timeseries_name = switch_table:exhaustion
2482026-07-17T01:58:58.621ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617497197Z } timeseries_name = switch_table:inserts
2492026-07-17T01:58:58.621ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617493937Z } timeseries_name = switch_table:occupancy
2502026-07-17T01:58:58.621ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617510517Z } timeseries_name = switch_table:update_misses
2512026-07-17T01:58:58.621ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:58:58.617503907Z } timeseries_name = switch_table:updates
2522026-07-17T01:58:58.624ZDEBGoximeter (clickhouse-client): inserting 26 new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
2532026-07-17T01:58:58.627ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 280 table_name = fields_i16
2542026-07-17T01:58:58.628ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 4 table_name = fields_ipaddr
2552026-07-17T01:58:58.629ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 775 table_name = fields_string
2562026-07-17T01:58:58.631ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 144 table_name = fields_u16
2572026-07-17T01:58:58.632ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 145 table_name = fields_u32
2582026-07-17T01:58:58.633ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 144 table_name = fields_u8
2592026-07-17T01:58:58.634ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 476 table_name = fields_uuid
2602026-07-17T01:58:58.636ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 4 table_name = measurements_bool
2612026-07-17T01:58:58.637ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 127 table_name = measurements_cumulativeu64
2622026-07-17T01:58:58.638ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 1 table_name = measurements_f64
2632026-07-17T01:58:58.640ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 2 table_name = measurements_histogramu64
2642026-07-17T01:58:58.641ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 36 table_name = measurements_u64
2652026-07-17T01:58:58.718ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2662026-07-17T01:58:58.747ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
2672026-07-17T01:58:58.747ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
2682026-07-17T01:58:58.749ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
2692026-07-17T01:58:58.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2702026-07-17T01:58:58.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2712026-07-17T01:58:58.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2722026-07-17T01:58:59.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2732026-07-17T01:58:59.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2742026-07-17T01:58:59.765ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2752026-07-17T01:59:00.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2762026-07-17T01:59:00.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2772026-07-17T01:59:00.763ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2782026-07-17T01:59:01.729ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = fd6b1220-c797-4056-b0da-35fb16e8d1c5 producer_ip = fd00:1122:3344:101::1 producer_port = 42412
2792026-07-17T01:59:01.729ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = fd6b1220-c797-4056-b0da-35fb16e8d1c5 producer_ip = fd00:1122:3344:101::1 producer_port = 42412
2802026-07-17T01:59:01.752ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 1692 producer_id = fd6b1220-c797-4056-b0da-35fb16e8d1c5 producer_ip = fd00:1122:3344:101::1 producer_port = 42412
2812026-07-17T01:59:01.755ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 1793
2822026-07-17T01:59:01.755ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 1793
2832026-07-17T01:59:01.755ZDEBGoximeter (clickhouse-client): unrolling 1793 total samples collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
2842026-07-17T01:59:01.756ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
2852026-07-17T01:59:01.761ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2862026-07-17T01:59:01.761ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2872026-07-17T01:59:01.763ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2882026-07-17T01:59:01.771ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 2439 table_name = fields_string
2892026-07-17T01:59:01.772ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 32 table_name = fields_u16
2902026-07-17T01:59:01.774ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 801 table_name = fields_u32
2912026-07-17T01:59:01.776ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 1299 table_name = fields_uuid
2922026-07-17T01:59:01.777ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 1743 table_name = measurements_cumulativeu64
2932026-07-17T01:59:01.779ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 32 table_name = measurements_histogramu64
2942026-07-17T01:59:01.781ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 18 table_name = measurements_u64
2952026-07-17T01:59:01.856ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2962026-07-17T01:59:02.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2972026-07-17T01:59:02.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2982026-07-17T01:59:02.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2992026-07-17T01:59:03.617ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 52
3002026-07-17T01:59:03.617ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 52
3012026-07-17T01:59:03.617ZDEBGoximeter (clickhouse-client): unrolling 52 total samples collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
3022026-07-17T01:59:03.617ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
3032026-07-17T01:59:03.621ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 50 table_name = fields_string
3042026-07-17T01:59:03.623ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 52 table_name = fields_uuid
3052026-07-17T01:59:03.624ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 40 table_name = measurements_cumulativeu64
3062026-07-17T01:59:03.625ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 12 table_name = measurements_u64
3072026-07-17T01:59:03.718ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
3082026-07-17T01:59:03.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3092026-07-17T01:59:03.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3102026-07-17T01:59:03.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3112026-07-17T01:59:04.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3122026-07-17T01:59:04.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3132026-07-17T01:59:04.765ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3142026-07-17T01:59:05.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3152026-07-17T01:59:05.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3162026-07-17T01:59:05.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3172026-07-17T01:59:06.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3182026-07-17T01:59:06.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3192026-07-17T01:59:06.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3202026-07-17T01:59:07.730ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
3212026-07-17T01:59:07.730ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
3222026-07-17T01:59:07.738ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
3232026-07-17T01:59:07.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3242026-07-17T01:59:07.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3252026-07-17T01:59:07.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3262026-07-17T01:59:08.617ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 270
3272026-07-17T01:59:08.617ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 270
3282026-07-17T01:59:08.618ZDEBGoximeter (clickhouse-client): unrolling 270 total samples collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
3292026-07-17T01:59:08.618ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
3302026-07-17T01:59:08.626ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 280 table_name = fields_i16
3312026-07-17T01:59:08.627ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 771 table_name = fields_string
3322026-07-17T01:59:08.629ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 140 table_name = fields_u16
3332026-07-17T01:59:08.630ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 145 table_name = fields_u32
3342026-07-17T01:59:08.631ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 144 table_name = fields_u8
3352026-07-17T01:59:08.633ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 472 table_name = fields_uuid
3362026-07-17T01:59:08.634ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 4 table_name = measurements_bool
3372026-07-17T01:59:08.635ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 205 table_name = measurements_cumulativeu64
3382026-07-17T01:59:08.636ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 1 table_name = measurements_f64
3392026-07-17T01:59:08.638ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 60 table_name = measurements_u64
3402026-07-17T01:59:08.718ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
3412026-07-17T01:59:08.747ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
3422026-07-17T01:59:08.747ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
3432026-07-17T01:59:08.749ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
3442026-07-17T01:59:08.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3452026-07-17T01:59:08.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3462026-07-17T01:59:08.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3472026-07-17T01:59:09.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3482026-07-17T01:59:09.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3492026-07-17T01:59:09.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3502026-07-17T01:59:10.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3512026-07-17T01:59:10.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3522026-07-17T01:59:10.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3532026-07-17T01:59:11.262ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = fd6b1220-c797-4056-b0da-35fb16e8d1c5 producer_ip = fd00:1122:3344:101::1 producer_port = 42412
3542026-07-17T01:59:11.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3552026-07-17T01:59:11.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3562026-07-17T01:59:11.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3572026-07-17T01:59:12.327ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:634
3582026-07-17T01:59:12.327ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?sort_by=id_ascending
3592026-07-17T01:59:12.331ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "7514afd5-fe5b-4d5f-808a-bea52bd1e3ee", "content-length": "991", "date": "Fri, 17 Jul 2026 01:59:12 GMT"} })
3602026-07-17T01:59:12.331ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDZiMTIyMC1jNzk3LTQwNTYtYjBkYS0zNWZiMTZlOGQxYzUifX0%3D
3612026-07-17T01:59:12.334ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDZiMTIyMC1jNzk3LTQwNTYtYjBkYS0zNWZiMTZlOGQxYzUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "49e7b7df-6956-430c-9e43-6a8ede010d36", "content-length": "29", "date": "Fri, 17 Jul 2026 01:59:12 GMT"} })
3622026-07-17T01:59:12.334ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:33107 collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 94b48d02-0980-4e18-94c9-12f8193ce7a1
3632026-07-17T01:59:12.335ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:38984 collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 9a95a123-1e6d-4334-b988-7e526a502d1b
3642026-07-17T01:59:12.335ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:709 n_current_tasks = 6 n_pruned_tasks = 0
3652026-07-17T01:59:12.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3662026-07-17T01:59:12.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3672026-07-17T01:59:12.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3682026-07-17T01:59:13.617ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 155
3692026-07-17T01:59:13.617ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 155
3702026-07-17T01:59:13.617ZDEBGoximeter (clickhouse-client): unrolling 155 total samples collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
3712026-07-17T01:59:13.617ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
3722026-07-17T01:59:13.622ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 4 table_name = fields_ipaddr
3732026-07-17T01:59:13.624ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 98 table_name = fields_string
3742026-07-17T01:59:13.625ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 27 table_name = fields_u16
3752026-07-17T01:59:13.626ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 79 table_name = fields_uuid
3762026-07-17T01:59:13.627ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 102 table_name = measurements_cumulativeu64
3772026-07-17T01:59:13.629ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 23 table_name = measurements_histogramu64
3782026-07-17T01:59:13.630ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 30 table_name = measurements_u64
3792026-07-17T01:59:13.718ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
3802026-07-17T01:59:13.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3812026-07-17T01:59:13.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3822026-07-17T01:59:13.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3832026-07-17T01:59:14.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3842026-07-17T01:59:14.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3852026-07-17T01:59:14.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3862026-07-17T01:59:15.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3872026-07-17T01:59:15.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3882026-07-17T01:59:15.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3892026-07-17T01:59:16.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 94b48d02-0980-4e18-94c9-12f8193ce7a1 producer_ip = fd00:1122:3344:101::c producer_port = 33107
3902026-07-17T01:59:16.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 94b48d02-0980-4e18-94c9-12f8193ce7a1 producer_ip = fd00:1122:3344:101::c producer_port = 33107
3912026-07-17T01:59:16.293ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 8 producer_id = 94b48d02-0980-4e18-94c9-12f8193ce7a1 producer_ip = fd00:1122:3344:101::c producer_port = 33107
3922026-07-17T01:59:16.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3932026-07-17T01:59:16.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3942026-07-17T01:59:16.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3952026-07-17T01:59:17.730ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
3962026-07-17T01:59:17.730ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
3972026-07-17T01:59:17.737ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
3982026-07-17T01:59:17.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3992026-07-17T01:59:17.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4002026-07-17T01:59:17.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4012026-07-17T01:59:18.617ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 278
4022026-07-17T01:59:18.617ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 278
4032026-07-17T01:59:18.617ZDEBGoximeter (clickhouse-client): unrolling 278 total samples collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
4042026-07-17T01:59:18.617ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
4052026-07-17T01:59:18.624ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 280 table_name = fields_i16
4062026-07-17T01:59:18.626ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 781 table_name = fields_string
4072026-07-17T01:59:18.627ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 145 table_name = fields_u16
4082026-07-17T01:59:18.628ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 145 table_name = fields_u32
4092026-07-17T01:59:18.630ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 144 table_name = fields_u8
4102026-07-17T01:59:18.631ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 480 table_name = fields_uuid
4112026-07-17T01:59:18.632ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 4 table_name = measurements_bool
4122026-07-17T01:59:18.633ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 205 table_name = measurements_cumulativeu64
4132026-07-17T01:59:18.634ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 1 table_name = measurements_f64
4142026-07-17T01:59:18.636ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 5 table_name = measurements_histogramu64
4152026-07-17T01:59:18.637ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 3 table_name = measurements_i64
4162026-07-17T01:59:18.638ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 60 table_name = measurements_u64
4172026-07-17T01:59:18.719ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
4182026-07-17T01:59:18.748ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
4192026-07-17T01:59:18.748ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
4202026-07-17T01:59:18.750ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
4212026-07-17T01:59:18.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4222026-07-17T01:59:18.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4232026-07-17T01:59:18.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4242026-07-17T01:59:19.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4252026-07-17T01:59:19.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4262026-07-17T01:59:19.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4272026-07-17T01:59:20.189ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 9a95a123-1e6d-4334-b988-7e526a502d1b producer_ip = fd00:1122:3344:101::a producer_port = 38984
4282026-07-17T01:59:20.189ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 9a95a123-1e6d-4334-b988-7e526a502d1b producer_ip = fd00:1122:3344:101::a producer_port = 38984
4292026-07-17T01:59:20.195ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 6 producer_id = 9a95a123-1e6d-4334-b988-7e526a502d1b producer_ip = fd00:1122:3344:101::a producer_port = 38984
4302026-07-17T01:59:20.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4312026-07-17T01:59:20.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4322026-07-17T01:59:20.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4332026-07-17T01:59:21.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4342026-07-17T01:59:21.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4352026-07-17T01:59:21.765ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4362026-07-17T01:59:22.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4372026-07-17T01:59:22.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4382026-07-17T01:59:22.765ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4392026-07-17T01:59:23.618ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 159
4402026-07-17T01:59:23.618ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 159
4412026-07-17T01:59:23.618ZDEBGoximeter (clickhouse-client): unrolling 159 total samples collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
4422026-07-17T01:59:23.618ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
4432026-07-17T01:59:23.620ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("database_transaction:retry_data"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "attempt", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-17T01:59:23.618237903Z } timeseries_name = database_transaction:retry_data
4442026-07-17T01:59:23.621ZDEBGoximeter (clickhouse-client): inserting 1 new timeseries schema collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
4452026-07-17T01:59:23.624ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 101 table_name = fields_string
4462026-07-17T01:59:23.625ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 25 table_name = fields_u16
4472026-07-17T01:59:23.627ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 1 table_name = fields_u32
4482026-07-17T01:59:23.628ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 80 table_name = fields_uuid
4492026-07-17T01:59:23.629ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 100 table_name = measurements_cumulativeu64
4502026-07-17T01:59:23.630ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 1 table_name = measurements_f64
4512026-07-17T01:59:23.632ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 25 table_name = measurements_histogramu64
4522026-07-17T01:59:23.633ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 3 table_name = measurements_i64
4532026-07-17T01:59:23.634ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 30 table_name = measurements_u64
4542026-07-17T01:59:23.718ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
4552026-07-17T01:59:23.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4562026-07-17T01:59:23.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4572026-07-17T01:59:23.765ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4582026-07-17T01:59:24.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4592026-07-17T01:59:24.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4602026-07-17T01:59:24.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4612026-07-17T01:59:25.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4622026-07-17T01:59:25.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4632026-07-17T01:59:25.763ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4642026-07-17T01:59:26.286ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 94b48d02-0980-4e18-94c9-12f8193ce7a1 producer_ip = fd00:1122:3344:101::c producer_port = 33107
4652026-07-17T01:59:26.286ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 94b48d02-0980-4e18-94c9-12f8193ce7a1 producer_ip = fd00:1122:3344:101::c producer_port = 33107
4662026-07-17T01:59:26.287ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = 94b48d02-0980-4e18-94c9-12f8193ce7a1 producer_ip = fd00:1122:3344:101::c producer_port = 33107
4672026-07-17T01:59:26.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4682026-07-17T01:59:26.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4692026-07-17T01:59:26.765ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4702026-07-17T01:59:27.327ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:634
4712026-07-17T01:59:27.327ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?sort_by=id_ascending
4722026-07-17T01:59:27.331ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e5fd02e-dbe0-4156-8894-d33d58a8868a", "content-length": "991", "date": "Fri, 17 Jul 2026 01:59:27 GMT"} })
4732026-07-17T01:59:27.331ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDZiMTIyMC1jNzk3LTQwNTYtYjBkYS0zNWZiMTZlOGQxYzUifX0%3D
4742026-07-17T01:59:27.334ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDZiMTIyMC1jNzk3LTQwNTYtYjBkYS0zNWZiMTZlOGQxYzUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "704aba47-cd54-41c4-830b-b95860b85b17", "content-length": "29", "date": "Fri, 17 Jul 2026 01:59:27 GMT"} })
4752026-07-17T01:59:27.334ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:709 n_current_tasks = 6 n_pruned_tasks = 0
4762026-07-17T01:59:27.731ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
4772026-07-17T01:59:27.731ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
4782026-07-17T01:59:27.739ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
4792026-07-17T01:59:27.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4802026-07-17T01:59:27.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4812026-07-17T01:59:27.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4822026-07-17T01:59:28.617ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 275
4832026-07-17T01:59:28.617ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 275
4842026-07-17T01:59:28.617ZDEBGoximeter (clickhouse-client): unrolling 275 total samples collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
4852026-07-17T01:59:28.617ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
4862026-07-17T01:59:28.626ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 280 table_name = fields_i16
4872026-07-17T01:59:28.628ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 781 table_name = fields_string
4882026-07-17T01:59:28.629ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 145 table_name = fields_u16
4892026-07-17T01:59:28.630ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 145 table_name = fields_u32
4902026-07-17T01:59:28.632ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 144 table_name = fields_u8
4912026-07-17T01:59:28.633ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 477 table_name = fields_uuid
4922026-07-17T01:59:28.635ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 4 table_name = measurements_bool
4932026-07-17T01:59:28.636ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 205 table_name = measurements_cumulativeu64
4942026-07-17T01:59:28.638ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 1 table_name = measurements_f64
4952026-07-17T01:59:28.640ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 5 table_name = measurements_histogramu64
4962026-07-17T01:59:28.641ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 60 table_name = measurements_u64
4972026-07-17T01:59:28.718ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
4982026-07-17T01:59:28.747ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
4992026-07-17T01:59:28.748ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
5002026-07-17T01:59:28.749ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
5012026-07-17T01:59:28.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5022026-07-17T01:59:28.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5032026-07-17T01:59:28.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5042026-07-17T01:59:29.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5052026-07-17T01:59:29.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5062026-07-17T01:59:29.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5072026-07-17T01:59:30.189ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 9a95a123-1e6d-4334-b988-7e526a502d1b producer_ip = fd00:1122:3344:101::a producer_port = 38984
5082026-07-17T01:59:30.189ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 9a95a123-1e6d-4334-b988-7e526a502d1b producer_ip = fd00:1122:3344:101::a producer_port = 38984
5092026-07-17T01:59:30.190ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 9a95a123-1e6d-4334-b988-7e526a502d1b producer_ip = fd00:1122:3344:101::a producer_port = 38984
5102026-07-17T01:59:30.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5112026-07-17T01:59:30.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5122026-07-17T01:59:30.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5132026-07-17T01:59:31.730ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = fd6b1220-c797-4056-b0da-35fb16e8d1c5 producer_ip = fd00:1122:3344:101::1 producer_port = 42412
5142026-07-17T01:59:31.730ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = fd6b1220-c797-4056-b0da-35fb16e8d1c5 producer_ip = fd00:1122:3344:101::1 producer_port = 42412
5152026-07-17T01:59:31.754ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 1844 producer_id = fd6b1220-c797-4056-b0da-35fb16e8d1c5 producer_ip = fd00:1122:3344:101::1 producer_port = 42412
5162026-07-17T01:59:31.757ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 1947
5172026-07-17T01:59:31.758ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 1947
5182026-07-17T01:59:31.758ZDEBGoximeter (clickhouse-client): unrolling 1947 total samples collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
5192026-07-17T01:59:31.758ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
5202026-07-17T01:59:31.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5212026-07-17T01:59:31.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5222026-07-17T01:59:31.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5232026-07-17T01:59:31.777ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 3303 table_name = fields_string
5242026-07-17T01:59:31.778ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 34 table_name = fields_u16
5252026-07-17T01:59:31.779ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 953 table_name = fields_u32
5262026-07-17T01:59:31.781ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 1883 table_name = fields_uuid
5272026-07-17T01:59:31.783ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 1743 table_name = measurements_cumulativeu64
5282026-07-17T01:59:31.785ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 34 table_name = measurements_histogramu64
5292026-07-17T01:59:31.786ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 170 table_name = measurements_u64
5302026-07-17T01:59:31.858ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
5312026-07-17T01:59:32.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5322026-07-17T01:59:32.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5332026-07-17T01:59:32.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5342026-07-17T01:59:33.617ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 52
5352026-07-17T01:59:33.617ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 52
5362026-07-17T01:59:33.617ZDEBGoximeter (clickhouse-client): unrolling 52 total samples collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
5372026-07-17T01:59:33.617ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
5382026-07-17T01:59:33.621ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 50 table_name = fields_string
5392026-07-17T01:59:33.622ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 52 table_name = fields_uuid
5402026-07-17T01:59:33.624ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 40 table_name = measurements_cumulativeu64
5412026-07-17T01:59:33.625ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 12 table_name = measurements_u64
5422026-07-17T01:59:33.718ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
5432026-07-17T01:59:33.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5442026-07-17T01:59:33.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5452026-07-17T01:59:33.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5462026-07-17T01:59:34.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5472026-07-17T01:59:34.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5482026-07-17T01:59:34.765ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5492026-07-17T01:59:35.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5502026-07-17T01:59:35.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5512026-07-17T01:59:35.765ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5522026-07-17T01:59:36.286ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 94b48d02-0980-4e18-94c9-12f8193ce7a1 producer_ip = fd00:1122:3344:101::c producer_port = 33107
5532026-07-17T01:59:36.286ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 94b48d02-0980-4e18-94c9-12f8193ce7a1 producer_ip = fd00:1122:3344:101::c producer_port = 33107
5542026-07-17T01:59:36.287ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = 94b48d02-0980-4e18-94c9-12f8193ce7a1 producer_ip = fd00:1122:3344:101::c producer_port = 33107
5552026-07-17T01:59:36.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5562026-07-17T01:59:36.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5572026-07-17T01:59:36.765ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5582026-07-17T01:59:37.730ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
5592026-07-17T01:59:37.730ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
5602026-07-17T01:59:37.738ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
5612026-07-17T01:59:37.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5622026-07-17T01:59:37.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5632026-07-17T01:59:37.765ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5642026-07-17T01:59:38.618ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 275
5652026-07-17T01:59:38.618ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 275
5662026-07-17T01:59:38.618ZDEBGoximeter (clickhouse-client): unrolling 275 total samples collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
5672026-07-17T01:59:38.618ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
5682026-07-17T01:59:38.626ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 280 table_name = fields_i16
5692026-07-17T01:59:38.627ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 781 table_name = fields_string
5702026-07-17T01:59:38.628ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 145 table_name = fields_u16
5712026-07-17T01:59:38.630ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 145 table_name = fields_u32
5722026-07-17T01:59:38.631ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 144 table_name = fields_u8
5732026-07-17T01:59:38.633ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 477 table_name = fields_uuid
5742026-07-17T01:59:38.634ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 4 table_name = measurements_bool
5752026-07-17T01:59:38.635ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 205 table_name = measurements_cumulativeu64
5762026-07-17T01:59:38.636ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 1 table_name = measurements_f64
5772026-07-17T01:59:38.638ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 5 table_name = measurements_histogramu64
5782026-07-17T01:59:38.639ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 60 table_name = measurements_u64
5792026-07-17T01:59:38.719ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
5802026-07-17T01:59:38.748ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
5812026-07-17T01:59:38.748ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
5822026-07-17T01:59:38.749ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
5832026-07-17T01:59:38.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5842026-07-17T01:59:38.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5852026-07-17T01:59:38.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5862026-07-17T01:59:39.253ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5872026-07-17T01:59:39.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5882026-07-17T01:59:39.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5892026-07-17T01:59:39.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5902026-07-17T01:59:40.190ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 9a95a123-1e6d-4334-b988-7e526a502d1b producer_ip = fd00:1122:3344:101::a producer_port = 38984
5912026-07-17T01:59:40.190ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 9a95a123-1e6d-4334-b988-7e526a502d1b producer_ip = fd00:1122:3344:101::a producer_port = 38984
5922026-07-17T01:59:40.190ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 9a95a123-1e6d-4334-b988-7e526a502d1b producer_ip = fd00:1122:3344:101::a producer_port = 38984
5932026-07-17T01:59:40.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5942026-07-17T01:59:40.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5952026-07-17T01:59:40.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5962026-07-17T01:59:41.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5972026-07-17T01:59:41.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5982026-07-17T01:59:41.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5992026-07-17T01:59:42.327ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:634
6002026-07-17T01:59:42.327ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?sort_by=id_ascending
6012026-07-17T01:59:42.332ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d51666b-58d8-444c-abff-dc5752dda6b3", "content-length": "1127", "date": "Fri, 17 Jul 2026 01:59:42 GMT"} })
6022026-07-17T01:59:42.332ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDZiMTIyMC1jNzk3LTQwNTYtYjBkYS0zNWZiMTZlOGQxYzUifX0%3D
6032026-07-17T01:59:42.335ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDZiMTIyMC1jNzk3LTQwNTYtYjBkYS0zNWZiMTZlOGQxYzUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "b072772b-2b65-4de2-81af-83c182aaa40d", "content-length": "29", "date": "Fri, 17 Jul 2026 01:59:42 GMT"} })
6042026-07-17T01:59:42.335ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e
6052026-07-17T01:59:42.335ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:709 n_current_tasks = 7 n_pruned_tasks = 0
6062026-07-17T01:59:42.523ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6072026-07-17T01:59:42.523ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6082026-07-17T01:59:42.531ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6092026-07-17T01:59:42.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6102026-07-17T01:59:42.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6112026-07-17T01:59:42.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6122026-07-17T01:59:43.523ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6132026-07-17T01:59:43.523ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6142026-07-17T01:59:43.524ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6152026-07-17T01:59:43.618ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 185
6162026-07-17T01:59:43.618ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 185
6172026-07-17T01:59:43.618ZDEBGoximeter (clickhouse-client): unrolling 185 total samples collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
6182026-07-17T01:59:43.618ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
6192026-07-17T01:59:43.623ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 4 table_name = fields_ipaddr
6202026-07-17T01:59:43.625ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 128 table_name = fields_string
6212026-07-17T01:59:43.626ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 29 table_name = fields_u16
6222026-07-17T01:59:43.627ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 109 table_name = fields_uuid
6232026-07-17T01:59:43.628ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 122 table_name = measurements_cumulativeu64
6242026-07-17T01:59:43.630ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 25 table_name = measurements_histogramu64
6252026-07-17T01:59:43.631ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 38 table_name = measurements_u64
6262026-07-17T01:59:43.720ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
6272026-07-17T01:59:43.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6282026-07-17T01:59:43.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6292026-07-17T01:59:43.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6302026-07-17T01:59:44.522ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6312026-07-17T01:59:44.522ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6322026-07-17T01:59:44.524ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6332026-07-17T01:59:44.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6342026-07-17T01:59:44.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6352026-07-17T01:59:44.765ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6362026-07-17T01:59:45.523ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6372026-07-17T01:59:45.523ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6382026-07-17T01:59:45.524ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6392026-07-17T01:59:45.555ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
6402026-07-17T01:59:45.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6412026-07-17T01:59:45.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6422026-07-17T01:59:45.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6432026-07-17T01:59:46.285ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 94b48d02-0980-4e18-94c9-12f8193ce7a1 producer_ip = fd00:1122:3344:101::c producer_port = 33107
6442026-07-17T01:59:46.285ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 94b48d02-0980-4e18-94c9-12f8193ce7a1 producer_ip = fd00:1122:3344:101::c producer_port = 33107
6452026-07-17T01:59:46.286ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = 94b48d02-0980-4e18-94c9-12f8193ce7a1 producer_ip = fd00:1122:3344:101::c producer_port = 33107
6462026-07-17T01:59:46.522ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6472026-07-17T01:59:46.522ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6482026-07-17T01:59:46.524ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6492026-07-17T01:59:46.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6502026-07-17T01:59:46.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6512026-07-17T01:59:46.765ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6522026-07-17T01:59:47.382ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
6532026-07-17T01:59:47.522ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6542026-07-17T01:59:47.522ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6552026-07-17T01:59:47.524ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6562026-07-17T01:59:47.731ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
6572026-07-17T01:59:47.731ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
6582026-07-17T01:59:47.737ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
6592026-07-17T01:59:47.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6602026-07-17T01:59:47.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6612026-07-17T01:59:47.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6622026-07-17T01:59:48.522ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6632026-07-17T01:59:48.522ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6642026-07-17T01:59:48.524ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6652026-07-17T01:59:48.618ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 349
6662026-07-17T01:59:48.618ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 349
6672026-07-17T01:59:48.618ZDEBGoximeter (clickhouse-client): unrolling 349 total samples collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
6682026-07-17T01:59:48.618ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
6692026-07-17T01:59:48.626ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 280 table_name = fields_i16
6702026-07-17T01:59:48.627ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 8 table_name = fields_ipaddr
6712026-07-17T01:59:48.629ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 811 table_name = fields_string
6722026-07-17T01:59:48.631ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 153 table_name = fields_u16
6732026-07-17T01:59:48.632ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 145 table_name = fields_u32
6742026-07-17T01:59:48.633ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 144 table_name = fields_u8
6752026-07-17T01:59:48.635ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 513 table_name = fields_uuid
6762026-07-17T01:59:48.636ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 4 table_name = measurements_bool
6772026-07-17T01:59:48.637ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 259 table_name = measurements_cumulativeu64
6782026-07-17T01:59:48.638ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 1 table_name = measurements_f64
6792026-07-17T01:59:48.640ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 5 table_name = measurements_histogramu64
6802026-07-17T01:59:48.641ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 80 table_name = measurements_u64
6812026-07-17T01:59:48.718ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
6822026-07-17T01:59:48.747ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
6832026-07-17T01:59:48.748ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
6842026-07-17T01:59:48.749ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
6852026-07-17T01:59:48.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6862026-07-17T01:59:48.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6872026-07-17T01:59:48.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6882026-07-17T01:59:49.522ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6892026-07-17T01:59:49.522ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6902026-07-17T01:59:49.524ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6912026-07-17T01:59:49.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6922026-07-17T01:59:49.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6932026-07-17T01:59:49.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6942026-07-17T01:59:50.189ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 9a95a123-1e6d-4334-b988-7e526a502d1b producer_ip = fd00:1122:3344:101::a producer_port = 38984
6952026-07-17T01:59:50.189ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 9a95a123-1e6d-4334-b988-7e526a502d1b producer_ip = fd00:1122:3344:101::a producer_port = 38984
6962026-07-17T01:59:50.190ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 9a95a123-1e6d-4334-b988-7e526a502d1b producer_ip = fd00:1122:3344:101::a producer_port = 38984
6972026-07-17T01:59:50.523ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6982026-07-17T01:59:50.523ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6992026-07-17T01:59:50.524ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7002026-07-17T01:59:50.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7012026-07-17T01:59:50.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7022026-07-17T01:59:50.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7032026-07-17T01:59:51.524ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7042026-07-17T01:59:51.524ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7052026-07-17T01:59:51.525ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7062026-07-17T01:59:51.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7072026-07-17T01:59:51.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7082026-07-17T01:59:51.765ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7092026-07-17T01:59:52.523ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7102026-07-17T01:59:52.523ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7112026-07-17T01:59:52.525ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7122026-07-17T01:59:52.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7132026-07-17T01:59:52.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7142026-07-17T01:59:52.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7152026-07-17T01:59:53.523ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7162026-07-17T01:59:53.523ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7172026-07-17T01:59:53.524ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7182026-07-17T01:59:53.589ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 9a95a123-1e6d-4334-b988-7e526a502d1b producer_ip = fd00:1122:3344:101::a producer_port = 38984
7192026-07-17T01:59:53.617ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 227
7202026-07-17T01:59:53.617ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 227
7212026-07-17T01:59:53.617ZDEBGoximeter (clickhouse-client): unrolling 227 total samples collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
7222026-07-17T01:59:53.617ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
7232026-07-17T01:59:53.623ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 4 table_name = fields_ipaddr
7242026-07-17T01:59:53.624ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 128 table_name = fields_string
7252026-07-17T01:59:53.625ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 29 table_name = fields_u16
7262026-07-17T01:59:53.626ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 109 table_name = fields_uuid
7272026-07-17T01:59:53.628ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 152 table_name = measurements_cumulativeu64
7282026-07-17T01:59:53.629ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 25 table_name = measurements_histogramu64
7292026-07-17T01:59:53.631ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 50 table_name = measurements_u64
7302026-07-17T01:59:53.718ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
7312026-07-17T01:59:53.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7322026-07-17T01:59:53.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7332026-07-17T01:59:53.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7342026-07-17T01:59:54.523ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7352026-07-17T01:59:54.523ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7362026-07-17T01:59:54.524ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7372026-07-17T01:59:54.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7382026-07-17T01:59:54.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7392026-07-17T01:59:54.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7402026-07-17T01:59:55.523ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7412026-07-17T01:59:55.523ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7422026-07-17T01:59:55.524ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7432026-07-17T01:59:55.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7442026-07-17T01:59:55.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7452026-07-17T01:59:55.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7462026-07-17T01:59:56.286ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 94b48d02-0980-4e18-94c9-12f8193ce7a1 producer_ip = fd00:1122:3344:101::c producer_port = 33107
7472026-07-17T01:59:56.286ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 94b48d02-0980-4e18-94c9-12f8193ce7a1 producer_ip = fd00:1122:3344:101::c producer_port = 33107
7482026-07-17T01:59:56.287ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = 94b48d02-0980-4e18-94c9-12f8193ce7a1 producer_ip = fd00:1122:3344:101::c producer_port = 33107
7492026-07-17T01:59:56.523ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7502026-07-17T01:59:56.523ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7512026-07-17T01:59:56.524ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7522026-07-17T01:59:56.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7532026-07-17T01:59:56.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7542026-07-17T01:59:56.765ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7552026-07-17T01:59:57.328ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:634
7562026-07-17T01:59:57.328ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?sort_by=id_ascending
7572026-07-17T01:59:57.331ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "c55131c3-56ca-4862-bd48-bf7284ffd42a", "content-length": "1276", "date": "Fri, 17 Jul 2026 01:59:57 GMT"} })
7582026-07-17T01:59:57.332ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDZiMTIyMC1jNzk3LTQwNTYtYjBkYS0zNWZiMTZlOGQxYzUifX0%3D
7592026-07-17T01:59:57.335ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDZiMTIyMC1jNzk3LTQwNTYtYjBkYS0zNWZiMTZlOGQxYzUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "4eac7d5f-d3f3-4f91-94b8-36a2c1aa9527", "content-length": "29", "date": "Fri, 17 Jul 2026 01:59:57 GMT"} })
7602026-07-17T01:59:57.335ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:61341 collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 3959e327-7393-4e79-b5d7-94ba24c5e1e8
7612026-07-17T01:59:57.335ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:709 n_current_tasks = 8 n_pruned_tasks = 0
7622026-07-17T01:59:57.523ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7632026-07-17T01:59:57.523ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7642026-07-17T01:59:57.524ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7652026-07-17T01:59:57.731ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
7662026-07-17T01:59:57.731ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
7672026-07-17T01:59:57.739ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = c9222c3d-78f0-4a97-a660-1b6406630a21 producer_ip = fd00:1122:3344:101::2 producer_port = 57735
7682026-07-17T01:59:57.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7692026-07-17T01:59:57.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7702026-07-17T01:59:57.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7712026-07-17T01:59:58.523ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7722026-07-17T01:59:58.523ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7732026-07-17T01:59:58.524ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7742026-07-17T01:59:58.618ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 349
7752026-07-17T01:59:58.618ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 349
7762026-07-17T01:59:58.618ZDEBGoximeter (clickhouse-client): unrolling 349 total samples collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
7772026-07-17T01:59:58.618ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
7782026-07-17T01:59:58.626ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 280 table_name = fields_i16
7792026-07-17T01:59:58.628ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 4 table_name = fields_ipaddr
7802026-07-17T01:59:58.630ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 811 table_name = fields_string
7812026-07-17T01:59:58.632ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 149 table_name = fields_u16
7822026-07-17T01:59:58.633ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 145 table_name = fields_u32
7832026-07-17T01:59:58.634ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 144 table_name = fields_u8
7842026-07-17T01:59:58.636ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 509 table_name = fields_uuid
7852026-07-17T01:59:58.637ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 4 table_name = measurements_bool
7862026-07-17T01:59:58.638ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 257 table_name = measurements_cumulativeu64
7872026-07-17T01:59:58.640ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 1 table_name = measurements_f64
7882026-07-17T01:59:58.641ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 7 table_name = measurements_histogramu64
7892026-07-17T01:59:58.643ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 80 table_name = measurements_u64
7902026-07-17T01:59:58.719ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
7912026-07-17T01:59:58.748ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
7922026-07-17T01:59:58.748ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
7932026-07-17T01:59:58.750ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 46ba6f5a-71a4-404a-b4c5-53ff6dff8565 producer_ip = fd00:1122:3344:101::b producer_port = 44729
7942026-07-17T01:59:58.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7952026-07-17T01:59:58.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7962026-07-17T01:59:58.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7972026-07-17T01:59:59.523ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7982026-07-17T01:59:59.523ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7992026-07-17T01:59:59.524ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8002026-07-17T01:59:59.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8012026-07-17T01:59:59.764ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8022026-07-17T01:59:59.766ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8032026-07-17T02:00:00.190ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 9a95a123-1e6d-4334-b988-7e526a502d1b producer_ip = fd00:1122:3344:101::a producer_port = 38984
8042026-07-17T02:00:00.190ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 9a95a123-1e6d-4334-b988-7e526a502d1b producer_ip = fd00:1122:3344:101::a producer_port = 38984
8052026-07-17T02:00:00.190ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 9a95a123-1e6d-4334-b988-7e526a502d1b producer_ip = fd00:1122:3344:101::a producer_port = 38984
8062026-07-17T02:00:00.522ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8072026-07-17T02:00:00.522ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8082026-07-17T02:00:00.523ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8092026-07-17T02:00:00.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8102026-07-17T02:00:00.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8112026-07-17T02:00:00.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8122026-07-17T02:00:01.306ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 3959e327-7393-4e79-b5d7-94ba24c5e1e8 producer_ip = fd00:1122:3344:101::2 producer_port = 61341
8132026-07-17T02:00:01.306ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 3959e327-7393-4e79-b5d7-94ba24c5e1e8 producer_ip = fd00:1122:3344:101::2 producer_port = 61341
8142026-07-17T02:00:01.319ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 3959e327-7393-4e79-b5d7-94ba24c5e1e8 producer_ip = fd00:1122:3344:101::2 producer_port = 61341
8152026-07-17T02:00:01.523ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8162026-07-17T02:00:01.523ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8172026-07-17T02:00:01.524ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8182026-07-17T02:00:01.731ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = fd6b1220-c797-4056-b0da-35fb16e8d1c5 producer_ip = fd00:1122:3344:101::1 producer_port = 42412
8192026-07-17T02:00:01.731ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = fd6b1220-c797-4056-b0da-35fb16e8d1c5 producer_ip = fd00:1122:3344:101::1 producer_port = 42412
8202026-07-17T02:00:01.758ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 1692 producer_id = fd6b1220-c797-4056-b0da-35fb16e8d1c5 producer_ip = fd00:1122:3344:101::1 producer_port = 42412
8212026-07-17T02:00:01.762ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 1848
8222026-07-17T02:00:01.762ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8232026-07-17T02:00:01.762ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8242026-07-17T02:00:01.763ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_samples = 1848
8252026-07-17T02:00:01.763ZDEBGoximeter (clickhouse-client): unrolling 1848 total samples collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
8262026-07-17T02:00:01.763ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4
8272026-07-17T02:00:01.764ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8282026-07-17T02:00:01.782ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 2491 table_name = fields_string
8292026-07-17T02:00:01.783ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 45 table_name = fields_u16
8302026-07-17T02:00:01.785ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 801 table_name = fields_u32
8312026-07-17T02:00:01.788ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 1340 table_name = fields_uuid
8322026-07-17T02:00:01.790ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 1773 table_name = measurements_cumulativeu64
8332026-07-17T02:00:01.793ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 45 table_name = measurements_histogramu64
8342026-07-17T02:00:01.794ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d id = a5bb4be6-e6e9-4e10-86fc-fd16fab399f4 n_rows = 30 table_name = measurements_u64
8352026-07-17T02:00:01.864ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
8362026-07-17T02:00:02.523ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8372026-07-17T02:00:02.523ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8382026-07-17T02:00:02.524ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4cb9bc7c-b0b7-4081-9485-9ba54150692e producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8392026-07-17T02:00:02.763ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8402026-07-17T02:00:02.763ZDEBGoximeter (collection-task): collecting from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8412026-07-17T02:00:02.765ZDEBGoximeter (collection-task): collected results from producer collector_id = 93dd07f2-0eef-4f8f-ae3f-2f9b9777a04e collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 7af01c8a-f2d4-4db2-8d1c-a433cdcce5ad producer_ip = fd00:1122:3344:101::1 producer_port = 8001