Max level shown:
1 [ Jul 29 01:13:30 Enabled. ]
2 [ Jul 29 01:13:30 Rereading configuration. ]
3 [ Jul 29 01:13:31 Rereading configuration. ]
4 [ Jul 29 01:13:34 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 &"). ]
5 [ Jul 29 01:13:34 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-07-29T01:13:35.004ZDEBGoximeter: registered DTrace probes
82026-07-29T01:13:35.010ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:299
92026-07-29T01:13:35.010ZDEBGoximeter: creating ClickHouse client
102026-07-29T01:13:35.031ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
112026-07-29T01:13:39.550ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:888 id = 53a82096-d3a8-443c-b715-9e55d35d413a
122026-07-29T01:13:39.550ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d
132026-07-29T01:13:39.550ZINFOoximeter (clickhouse-client): reading db version collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:788 id = 53a82096-d3a8-443c-b715-9e55d35d413a
142026-07-29T01:13:39.551ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:888 id = 53a82096-d3a8-443c-b715-9e55d35d413a
152026-07-29T01:13:39.552ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:793 id = 53a82096-d3a8-443c-b715-9e55d35d413a version = 0
162026-07-29T01:13:39.552ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:798 id = 53a82096-d3a8-443c-b715-9e55d35d413a
172026-07-29T01:13:39.552ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
182026-07-29T01:13:39.820ZINFOoximeter (clickhouse-client): inserting current version collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:819 id = 53a82096-d3a8-443c-b715-9e55d35d413a version = 14
192026-07-29T01:13:39.842ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 5b6a36c6-c8af-4c9a-ac14-a32624d01a0d
202026-07-29T01:13:39.855ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-07-29T01:13:39.855ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-07-29T01:13:39.855ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-07-29T01:13:39.855ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-07-29T01:13:39.855ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:335 local_addr = [fd00:1122:3344:101::d]:12223
252026-07-29T01:13:39.859ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-07-29T01:13:39.859ZDEBGoximeter: registered USDT probes
272026-07-29T01:13:39.859ZDEBGoximeter: contacting nexus
282026-07-29T01:13:39.886ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
292026-07-29T01:13:39.888ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
302026-07-29T01:13:39.888ZWARNoximeter: failed to contact nexus, will retry in 361.600422ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:413
312026-07-29T01:13:40.251ZDEBGoximeter: contacting nexus
322026-07-29T01:13:40.251ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
332026-07-29T01:13:40.251ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
342026-07-29T01:13:40.251ZWARNoximeter: failed to contact nexus, will retry in 524.043649ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:413
352026-07-29T01:13:40.776ZDEBGoximeter: contacting nexus
362026-07-29T01:13:40.777ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
372026-07-29T01:13:40.933ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "2e438dab-634f-4ef4-b394-b163487f2ad7", "date": "Wed, 29 Jul 2026 01:13:40 GMT"} })
382026-07-29T01:13:40.933ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:431 id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5
392026-07-29T01:13:40.933ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:626
402026-07-29T01:13:40.934ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
412026-07-29T01:13:40.936ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/4ff22963-5ae7-4fe3-a616-ec8cdb8979d5/producers?sort_by=id_ascending
422026-07-29T01:13:41.195ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/4ff22963-5ae7-4fe3-a616-ec8cdb8979d5/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fc20efd-bcda-4446-b6e4-1d1ad10eddfb", "content-length": "29", "date": "Wed, 29 Jul 2026 01:13:41 GMT"} })
432026-07-29T01:13:41.195ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 0 n_pruned_tasks = 0
442026-07-29T01:13:44.843ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 4
452026-07-29T01:13:44.843ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 4
462026-07-29T01:13:44.843ZDEBGoximeter (clickhouse-client): unrolling 4 total samples collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
472026-07-29T01:13:44.844ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
482026-07-29T01:13:44.847ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:database_queue_depth"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "collector_sink", field_type: String, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:13:44.844879864Z } timeseries_name = oximeter_collector:database_queue_depth
492026-07-29T01:13:44.847ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:database_samples_dropped"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "collector_sink", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:13:44.844871384Z } timeseries_name = oximeter_collector:database_samples_dropped
502026-07-29T01:13:44.847ZDEBGoximeter (clickhouse-client): inserting 2 new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
512026-07-29T01:13:44.858ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 4 table_name = fields_ipaddr
522026-07-29T01:13:44.860ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 4 table_name = fields_string
532026-07-29T01:13:44.863ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 4 table_name = fields_u16
542026-07-29T01:13:44.867ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 4 table_name = fields_uuid
552026-07-29T01:13:44.870ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 2 table_name = measurements_cumulativeu64
562026-07-29T01:13:44.873ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 2 table_name = measurements_histogramu64
572026-07-29T01:13:44.945ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
582026-07-29T01:13:49.843ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d
592026-07-29T01:13:49.843ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d
602026-07-29T01:13:54.843ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d
612026-07-29T01:13:54.843ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d
622026-07-29T01:13:55.935ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
632026-07-29T01:13:55.935ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/4ff22963-5ae7-4fe3-a616-ec8cdb8979d5/producers?sort_by=id_ascending
642026-07-29T01:13:55.939ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/4ff22963-5ae7-4fe3-a616-ec8cdb8979d5/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b6f7576-f678-49ee-877f-87305b5aa1cd", "content-length": "436", "date": "Wed, 29 Jul 2026 01:13:55 GMT"} })
652026-07-29T01:13:55.941ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/4ff22963-5ae7-4fe3-a616-ec8cdb8979d5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWMwN2ZhZC01OGUwLTRlNDYtOGU3ZS04YjBmMzJjMDViOTMifX0%3D
662026-07-29T01:13:55.954ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/4ff22963-5ae7-4fe3-a616-ec8cdb8979d5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWMwN2ZhZC01OGUwLTRlNDYtOGU3ZS04YjBmMzJjMDViOTMifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbf0aa1d-b492-49f2-9ca5-f39c53c0a448", "content-length": "29", "date": "Wed, 29 Jul 2026 01:13:55 GMT"} })
672026-07-29T01:13:55.954ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:37208 collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 42775a5e-8870-43bf-b621-14b499d6c082
682026-07-29T01:13:55.954ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93
692026-07-29T01:13:55.954ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 2 n_pruned_tasks = 0
702026-07-29T01:13:56.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
712026-07-29T01:13:56.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
722026-07-29T01:13:56.028ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
732026-07-29T01:13:57.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
742026-07-29T01:13:57.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
752026-07-29T01:13:57.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
762026-07-29T01:13:58.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
772026-07-29T01:13:58.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
782026-07-29T01:13:58.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
792026-07-29T01:13:59.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
802026-07-29T01:13:59.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
812026-07-29T01:13:59.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
822026-07-29T01:13:59.844ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 16
832026-07-29T01:13:59.844ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 16
842026-07-29T01:13:59.844ZDEBGoximeter (clickhouse-client): unrolling 16 total samples collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
852026-07-29T01:13:59.844ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
862026-07-29T01:13:59.855ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:13:59.844543512Z } timeseries_name = mg_lower:routes_blocked_by_link_state
872026-07-29T01:13:59.855ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:13:59.844533301Z } timeseries_name = static_routing_config:static_nexthops
882026-07-29T01:13:59.855ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:13:59.844529291Z } timeseries_name = static_routing_config:static_routes
892026-07-29T01:13:59.855ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:13:59.844541881Z } timeseries_name = switch_rib:active_routes
902026-07-29T01:13:59.855ZDEBGoximeter (clickhouse-client): inserting 4 new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
912026-07-29T01:13:59.859ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 4 table_name = fields_string
922026-07-29T01:13:59.861ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 8 table_name = fields_uuid
932026-07-29T01:13:59.862ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 8 table_name = measurements_cumulativeu64
942026-07-29T01:13:59.864ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 8 table_name = measurements_u64
952026-07-29T01:13:59.945ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
962026-07-29T01:14:00.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
972026-07-29T01:14:00.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
982026-07-29T01:14:00.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
992026-07-29T01:14:01.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1002026-07-29T01:14:01.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1012026-07-29T01:14:01.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1022026-07-29T01:14:02.009ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1032026-07-29T01:14:02.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1042026-07-29T01:14:02.010ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1052026-07-29T01:14:02.900ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 42775a5e-8870-43bf-b621-14b499d6c082 producer_ip = fd00:1122:3344:101::2 producer_port = 37208
1062026-07-29T01:14:02.900ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 42775a5e-8870-43bf-b621-14b499d6c082 producer_ip = fd00:1122:3344:101::2 producer_port = 37208
1072026-07-29T01:14:02.920ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 192 producer_id = 42775a5e-8870-43bf-b621-14b499d6c082 producer_ip = fd00:1122:3344:101::2 producer_port = 37208
1082026-07-29T01:14:03.009ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1092026-07-29T01:14:03.009ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1102026-07-29T01:14:03.010ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1112026-07-29T01:14:04.009ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1122026-07-29T01:14:04.009ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1132026-07-29T01:14:04.010ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1142026-07-29T01:14:04.843ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 212
1152026-07-29T01:14:04.844ZDEBGoximeter (clickhouse-client): unrolling 212 total samples collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
1162026-07-29T01:14:04.844ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 212
1172026-07-29T01:14:04.844ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
1182026-07-29T01:14:04.853ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:04.843963305Z } timeseries_name = switch_port_control_data_link:bytes_received
1192026-07-29T01:14:04.853ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:04.844009116Z } timeseries_name = switch_port_control_data_link:bytes_sent
1202026-07-29T01:14:04.853ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:04.843945575Z } timeseries_name = switch_port_control_data_link:errors_received
1212026-07-29T01:14:04.853ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:04.843955015Z } timeseries_name = switch_port_control_data_link:errors_sent
1222026-07-29T01:14:04.853ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:04.843972886Z } timeseries_name = switch_port_control_data_link:packets_received
1232026-07-29T01:14:04.853ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:04.844029087Z } timeseries_name = switch_port_control_data_link:packets_sent
1242026-07-29T01:14:04.855ZDEBGoximeter (clickhouse-client): inserting 6 new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
1252026-07-29T01:14:04.860ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 24 table_name = fields_i16
1262026-07-29T01:14:04.862ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 124 table_name = fields_string
1272026-07-29T01:14:04.864ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 12 table_name = fields_u16
1282026-07-29T01:14:04.866ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 24 table_name = fields_u32
1292026-07-29T01:14:04.867ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 12 table_name = fields_u8
1302026-07-29T01:14:04.869ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 44 table_name = fields_uuid
1312026-07-29T01:14:04.871ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 202 table_name = measurements_cumulativeu64
1322026-07-29T01:14:04.872ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 10 table_name = measurements_u64
1332026-07-29T01:14:04.945ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1342026-07-29T01:14:05.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1352026-07-29T01:14:05.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1362026-07-29T01:14:05.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1372026-07-29T01:14:05.999ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1382026-07-29T01:14:06.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1392026-07-29T01:14:06.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1402026-07-29T01:14:06.010ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1412026-07-29T01:14:07.009ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1422026-07-29T01:14:07.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1432026-07-29T01:14:07.010ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1442026-07-29T01:14:08.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1452026-07-29T01:14:08.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1462026-07-29T01:14:08.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1472026-07-29T01:14:09.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1482026-07-29T01:14:09.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1492026-07-29T01:14:09.010ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1502026-07-29T01:14:09.844ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 22
1512026-07-29T01:14:09.844ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 22
1522026-07-29T01:14:09.844ZDEBGoximeter (clickhouse-client): unrolling 22 total samples collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
1532026-07-29T01:14:09.844ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
1542026-07-29T01:14:09.847ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:09.844717502Z } timeseries_name = oximeter_collector:collections
1552026-07-29T01:14:09.847ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:samples_collected"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:09.844720002Z } timeseries_name = oximeter_collector:samples_collected
1562026-07-29T01:14:09.847ZDEBGoximeter (clickhouse-client): inserting 2 new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
1572026-07-29T01:14:09.851ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 4 table_name = fields_ipaddr
1582026-07-29T01:14:09.853ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 6 table_name = fields_string
1592026-07-29T01:14:09.855ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 4 table_name = fields_u16
1602026-07-29T01:14:09.856ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 12 table_name = fields_uuid
1612026-07-29T01:14:09.858ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 12 table_name = measurements_cumulativeu64
1622026-07-29T01:14:09.860ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 10 table_name = measurements_u64
1632026-07-29T01:14:09.945ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1642026-07-29T01:14:10.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1652026-07-29T01:14:10.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1662026-07-29T01:14:10.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1672026-07-29T01:14:10.935ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
1682026-07-29T01:14:10.935ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/4ff22963-5ae7-4fe3-a616-ec8cdb8979d5/producers?sort_by=id_ascending
1692026-07-29T01:14:10.945ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/4ff22963-5ae7-4fe3-a616-ec8cdb8979d5/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "d09d2fdf-bb8d-4daf-9641-066cc4bd1d79", "content-length": "572", "date": "Wed, 29 Jul 2026 01:14:10 GMT"} })
1702026-07-29T01:14:10.945ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/4ff22963-5ae7-4fe3-a616-ec8cdb8979d5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDg3YTQ4ZS0yNzEwLTRlZjgtYjA1NC1lYmNjODdhYTc1YjgifX0%3D
1712026-07-29T01:14:10.955ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/4ff22963-5ae7-4fe3-a616-ec8cdb8979d5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDg3YTQ4ZS0yNzEwLTRlZjgtYjA1NC1lYmNjODdhYTc1YjgifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b2fff28-378e-4057-ba7a-d0b3d26275cd", "content-length": "29", "date": "Wed, 29 Jul 2026 01:14:10 GMT"} })
1722026-07-29T01:14:10.955ZDEBGoximeter (oximeter-agent): received request to register existing metric producer, updating collection information address = [fd00:1122:3344:101::2]:35427 collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = 42775a5e-8870-43bf-b621-14b499d6c082
1732026-07-29T01:14:10.955ZDEBGoximeter (collection-task-handle): notified collection task of new producer endpoint collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 42775a5e-8870-43bf-b621-14b499d6c082 producer_ip = fd00:1122:3344:101::2 producer_port = 37208
1742026-07-29T01:14:10.955ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8
1752026-07-29T01:14:10.955ZDEBGoximeter (collection-task): collection task received request to update its producer information address = [fd00:1122:3344:101::2]:35427 collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = 42775a5e-8870-43bf-b621-14b499d6c082 producer_ip = fd00:1122:3344:101::2 producer_port = 37208
1762026-07-29T01:14:10.955ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 3 n_pruned_tasks = 0
1772026-07-29T01:14:11.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1782026-07-29T01:14:11.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1792026-07-29T01:14:11.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1802026-07-29T01:14:11.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1812026-07-29T01:14:11.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1822026-07-29T01:14:11.136ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1832026-07-29T01:14:12.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1842026-07-29T01:14:12.011ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1852026-07-29T01:14:12.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1862026-07-29T01:14:12.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1872026-07-29T01:14:12.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1882026-07-29T01:14:12.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1892026-07-29T01:14:12.715ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 42775a5e-8870-43bf-b621-14b499d6c082 producer_ip = fd00:1122:3344:101::2 producer_port = 37208
1902026-07-29T01:14:12.715ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 42775a5e-8870-43bf-b621-14b499d6c082 producer_ip = fd00:1122:3344:101::2 producer_port = 37208
1912026-07-29T01:14:12.737ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 42775a5e-8870-43bf-b621-14b499d6c082 producer_ip = fd00:1122:3344:101::2 producer_port = 37208
1922026-07-29T01:14:13.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1932026-07-29T01:14:13.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1942026-07-29T01:14:13.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1952026-07-29T01:14:13.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1962026-07-29T01:14:13.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1972026-07-29T01:14:13.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1982026-07-29T01:14:14.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1992026-07-29T01:14:14.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2002026-07-29T01:14:14.010ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2012026-07-29T01:14:14.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2022026-07-29T01:14:14.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2032026-07-29T01:14:14.131ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2042026-07-29T01:14:14.844ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 264
2052026-07-29T01:14:14.844ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 264
2062026-07-29T01:14:14.844ZDEBGoximeter (clickhouse-client): unrolling 264 total samples collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
2072026-07-29T01:14:14.845ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
2082026-07-29T01:14:14.848ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844861868Z } timeseries_name = ddm_router:originated_tunnel_endpoints
2092026-07-29T01:14:14.848ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844860526Z } timeseries_name = ddm_router:originated_underlay_prefixes
2102026-07-29T01:14:14.848ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844868532Z } timeseries_name = ddm_session:advertisements_received
2112026-07-29T01:14:14.848ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844866743Z } timeseries_name = ddm_session:advertisements_sent
2122026-07-29T01:14:14.848ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844879596Z } timeseries_name = ddm_session:imported_tunnel_endpoints
2132026-07-29T01:14:14.848ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844878396Z } timeseries_name = ddm_session:imported_underlay_prefixes
2142026-07-29T01:14:14.848ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844870801Z } timeseries_name = ddm_session:peer_address_changes
2152026-07-29T01:14:14.848ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844869545Z } timeseries_name = ddm_session:peer_expirations
2162026-07-29T01:14:14.848ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844873146Z } timeseries_name = ddm_session:peer_sessions_established
2172026-07-29T01:14:14.848ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844865532Z } timeseries_name = ddm_session:solicitations_received
2182026-07-29T01:14:14.848ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844863676Z } timeseries_name = ddm_session:solicitations_sent
2192026-07-29T01:14:14.849ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844877046Z } timeseries_name = ddm_session:update_send_fail
2202026-07-29T01:14:14.849ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844875743Z } timeseries_name = ddm_session:updates_received
2212026-07-29T01:14:14.849ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844874290Z } timeseries_name = ddm_session:updates_sent
2222026-07-29T01:14:14.849ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.845008157Z } timeseries_name = dendrite:sample_collection_duration
2232026-07-29T01:14:14.849ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844898665Z } timeseries_name = switch_data_link:link_enabled
2242026-07-29T01:14:14.849ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844904852Z } timeseries_name = switch_data_link:link_up
2252026-07-29T01:14:14.849ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844910646Z } timeseries_name = switch_table:capacity
2262026-07-29T01:14:14.849ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844945747Z } timeseries_name = switch_table:collisions
2272026-07-29T01:14:14.849ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844959266Z } timeseries_name = switch_table:delete_misses
2282026-07-29T01:14:14.849ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844931881Z } timeseries_name = switch_table:deletes
2292026-07-29T01:14:14.849ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844974595Z } timeseries_name = switch_table:exhaustion
2302026-07-29T01:14:14.849ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844924250Z } timeseries_name = switch_table:inserts
2312026-07-29T01:14:14.850ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844920650Z } timeseries_name = switch_table:occupancy
2322026-07-29T01:14:14.850ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844955412Z } timeseries_name = switch_table:update_misses
2332026-07-29T01:14:14.850ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:14.844935462Z } timeseries_name = switch_table:updates
2342026-07-29T01:14:14.851ZDEBGoximeter (clickhouse-client): inserting 26 new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
2352026-07-29T01:14:14.856ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 280 table_name = fields_i16
2362026-07-29T01:14:14.858ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 775 table_name = fields_string
2372026-07-29T01:14:14.860ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 140 table_name = fields_u16
2382026-07-29T01:14:14.862ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 145 table_name = fields_u32
2392026-07-29T01:14:14.863ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 144 table_name = fields_u8
2402026-07-29T01:14:14.865ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 480 table_name = fields_uuid
2412026-07-29T01:14:14.867ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 4 table_name = measurements_bool
2422026-07-29T01:14:14.869ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 195 table_name = measurements_cumulativeu64
2432026-07-29T01:14:14.871ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 1 table_name = measurements_f64
2442026-07-29T01:14:14.873ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 64 table_name = measurements_u64
2452026-07-29T01:14:14.945ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2462026-07-29T01:14:15.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2472026-07-29T01:14:15.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2482026-07-29T01:14:15.010ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2492026-07-29T01:14:15.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2502026-07-29T01:14:15.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2512026-07-29T01:14:15.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2522026-07-29T01:14:16.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2532026-07-29T01:14:16.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2542026-07-29T01:14:16.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2552026-07-29T01:14:16.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2562026-07-29T01:14:16.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2572026-07-29T01:14:16.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2582026-07-29T01:14:17.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2592026-07-29T01:14:17.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2602026-07-29T01:14:17.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2612026-07-29T01:14:17.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2622026-07-29T01:14:17.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2632026-07-29T01:14:17.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2642026-07-29T01:14:18.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2652026-07-29T01:14:18.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2662026-07-29T01:14:18.010ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2672026-07-29T01:14:18.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2682026-07-29T01:14:18.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2692026-07-29T01:14:18.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2702026-07-29T01:14:19.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2712026-07-29T01:14:19.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2722026-07-29T01:14:19.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2732026-07-29T01:14:19.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2742026-07-29T01:14:19.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2752026-07-29T01:14:19.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2762026-07-29T01:14:19.844ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 150
2772026-07-29T01:14:19.844ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 150
2782026-07-29T01:14:19.844ZDEBGoximeter (clickhouse-client): unrolling 150 total samples collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
2792026-07-29T01:14:19.844ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
2802026-07-29T01:14:19.854ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 54 table_name = fields_string
2812026-07-29T01:14:19.855ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 60 table_name = fields_uuid
2822026-07-29T01:14:19.857ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 110 table_name = measurements_cumulativeu64
2832026-07-29T01:14:19.859ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 40 table_name = measurements_u64
2842026-07-29T01:14:19.945ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2852026-07-29T01:14:20.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2862026-07-29T01:14:20.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2872026-07-29T01:14:20.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2882026-07-29T01:14:20.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2892026-07-29T01:14:20.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2902026-07-29T01:14:20.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2912026-07-29T01:14:21.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2922026-07-29T01:14:21.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2932026-07-29T01:14:21.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2942026-07-29T01:14:21.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2952026-07-29T01:14:21.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2962026-07-29T01:14:21.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2972026-07-29T01:14:22.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2982026-07-29T01:14:22.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2992026-07-29T01:14:22.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3002026-07-29T01:14:22.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3012026-07-29T01:14:22.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3022026-07-29T01:14:22.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3032026-07-29T01:14:22.715ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 42775a5e-8870-43bf-b621-14b499d6c082 producer_ip = fd00:1122:3344:101::2 producer_port = 37208
3042026-07-29T01:14:22.715ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 42775a5e-8870-43bf-b621-14b499d6c082 producer_ip = fd00:1122:3344:101::2 producer_port = 37208
3052026-07-29T01:14:22.723ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 42775a5e-8870-43bf-b621-14b499d6c082 producer_ip = fd00:1122:3344:101::2 producer_port = 37208
3062026-07-29T01:14:23.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3072026-07-29T01:14:23.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3082026-07-29T01:14:23.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3092026-07-29T01:14:23.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3102026-07-29T01:14:23.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3112026-07-29T01:14:23.131ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3122026-07-29T01:14:24.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3132026-07-29T01:14:24.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3142026-07-29T01:14:24.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3152026-07-29T01:14:24.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3162026-07-29T01:14:24.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3172026-07-29T01:14:24.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3182026-07-29T01:14:24.844ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 290
3192026-07-29T01:14:24.844ZDEBGoximeter (clickhouse-client): unrolling 290 total samples collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
3202026-07-29T01:14:24.844ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 290
3212026-07-29T01:14:24.844ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
3222026-07-29T01:14:24.853ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 280 table_name = fields_i16
3232026-07-29T01:14:24.856ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 775 table_name = fields_string
3242026-07-29T01:14:24.857ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 140 table_name = fields_u16
3252026-07-29T01:14:24.859ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 145 table_name = fields_u32
3262026-07-29T01:14:24.861ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 144 table_name = fields_u8
3272026-07-29T01:14:24.863ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 480 table_name = fields_uuid
3282026-07-29T01:14:24.864ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 4 table_name = measurements_bool
3292026-07-29T01:14:24.866ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 215 table_name = measurements_cumulativeu64
3302026-07-29T01:14:24.867ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 1 table_name = measurements_f64
3312026-07-29T01:14:24.869ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 70 table_name = measurements_u64
3322026-07-29T01:14:24.946ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
3332026-07-29T01:14:25.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3342026-07-29T01:14:25.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3352026-07-29T01:14:25.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3362026-07-29T01:14:25.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3372026-07-29T01:14:25.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3382026-07-29T01:14:25.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3392026-07-29T01:14:25.935ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
3402026-07-29T01:14:25.935ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/4ff22963-5ae7-4fe3-a616-ec8cdb8979d5/producers?sort_by=id_ascending
3412026-07-29T01:14:25.939ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/4ff22963-5ae7-4fe3-a616-ec8cdb8979d5/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ef15612-c30c-4a56-83a1-afb196b7c308", "content-length": "857", "date": "Wed, 29 Jul 2026 01:14:25 GMT"} })
3422026-07-29T01:14:25.939ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/4ff22963-5ae7-4fe3-a616-ec8cdb8979d5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDg3YTQ4ZS0yNzEwLTRlZjgtYjA1NC1lYmNjODdhYTc1YjgifX0%3D
3432026-07-29T01:14:25.942ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/4ff22963-5ae7-4fe3-a616-ec8cdb8979d5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDg3YTQ4ZS0yNzEwLTRlZjgtYjA1NC1lYmNjODdhYTc1YjgifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "65ae97ae-3b82-45b6-87b6-430dc7a4c5fe", "content-length": "29", "date": "Wed, 29 Jul 2026 01:14:25 GMT"} })
3442026-07-29T01:14:25.942ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38
3452026-07-29T01:14:25.942ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:61629 collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 44ef2097-07f5-4bb3-be17-ed18ff58a453
3462026-07-29T01:14:25.942ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 5 n_pruned_tasks = 0
3472026-07-29T01:14:26.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3482026-07-29T01:14:26.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3492026-07-29T01:14:26.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3502026-07-29T01:14:26.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3512026-07-29T01:14:26.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3522026-07-29T01:14:26.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3532026-07-29T01:14:26.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3542026-07-29T01:14:26.196ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3552026-07-29T01:14:26.204ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3562026-07-29T01:14:27.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3572026-07-29T01:14:27.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3582026-07-29T01:14:27.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3592026-07-29T01:14:27.071ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 44ef2097-07f5-4bb3-be17-ed18ff58a453 producer_ip = fd00:1122:3344:101::2 producer_port = 61629
3602026-07-29T01:14:27.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3612026-07-29T01:14:27.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3622026-07-29T01:14:27.131ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3632026-07-29T01:14:27.196ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3642026-07-29T01:14:27.196ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3652026-07-29T01:14:27.198ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3662026-07-29T01:14:28.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3672026-07-29T01:14:28.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3682026-07-29T01:14:28.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3692026-07-29T01:14:28.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3702026-07-29T01:14:28.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3712026-07-29T01:14:28.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3722026-07-29T01:14:28.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3732026-07-29T01:14:28.195ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3742026-07-29T01:14:28.196ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3752026-07-29T01:14:29.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3762026-07-29T01:14:29.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3772026-07-29T01:14:29.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3782026-07-29T01:14:29.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3792026-07-29T01:14:29.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3802026-07-29T01:14:29.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3812026-07-29T01:14:29.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3822026-07-29T01:14:29.195ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3832026-07-29T01:14:29.196ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3842026-07-29T01:14:29.844ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 208
3852026-07-29T01:14:29.844ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 208
3862026-07-29T01:14:29.844ZDEBGoximeter (clickhouse-client): unrolling 208 total samples collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
3872026-07-29T01:14:29.844ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
3882026-07-29T01:14:29.850ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 4 table_name = fields_ipaddr
3892026-07-29T01:14:29.852ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 82 table_name = fields_string
3902026-07-29T01:14:29.854ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 4 table_name = fields_u16
3912026-07-29T01:14:29.856ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 92 table_name = fields_uuid
3922026-07-29T01:14:29.858ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 152 table_name = measurements_cumulativeu64
3932026-07-29T01:14:29.859ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 56 table_name = measurements_u64
3942026-07-29T01:14:29.945ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
3952026-07-29T01:14:30.011ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3962026-07-29T01:14:30.011ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3972026-07-29T01:14:30.012ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3982026-07-29T01:14:30.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3992026-07-29T01:14:30.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4002026-07-29T01:14:30.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4012026-07-29T01:14:30.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4022026-07-29T01:14:30.195ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4032026-07-29T01:14:30.196ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4042026-07-29T01:14:31.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4052026-07-29T01:14:31.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4062026-07-29T01:14:31.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4072026-07-29T01:14:31.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4082026-07-29T01:14:31.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4092026-07-29T01:14:31.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4102026-07-29T01:14:31.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4112026-07-29T01:14:31.195ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4122026-07-29T01:14:31.196ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4132026-07-29T01:14:32.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4142026-07-29T01:14:32.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4152026-07-29T01:14:32.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4162026-07-29T01:14:32.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4172026-07-29T01:14:32.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4182026-07-29T01:14:32.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4192026-07-29T01:14:32.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4202026-07-29T01:14:32.195ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4212026-07-29T01:14:32.196ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4222026-07-29T01:14:32.715ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 42775a5e-8870-43bf-b621-14b499d6c082 producer_ip = fd00:1122:3344:101::2 producer_port = 37208
4232026-07-29T01:14:32.715ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 42775a5e-8870-43bf-b621-14b499d6c082 producer_ip = fd00:1122:3344:101::2 producer_port = 37208
4242026-07-29T01:14:32.723ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 42775a5e-8870-43bf-b621-14b499d6c082 producer_ip = fd00:1122:3344:101::2 producer_port = 37208
4252026-07-29T01:14:33.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4262026-07-29T01:14:33.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4272026-07-29T01:14:33.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4282026-07-29T01:14:33.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4292026-07-29T01:14:33.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4302026-07-29T01:14:33.131ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4312026-07-29T01:14:33.196ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4322026-07-29T01:14:33.196ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4332026-07-29T01:14:33.197ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4342026-07-29T01:14:33.928ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4352026-07-29T01:14:34.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4362026-07-29T01:14:34.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4372026-07-29T01:14:34.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4382026-07-29T01:14:34.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4392026-07-29T01:14:34.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4402026-07-29T01:14:34.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4412026-07-29T01:14:34.196ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4422026-07-29T01:14:34.196ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4432026-07-29T01:14:34.197ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4442026-07-29T01:14:34.844ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 362
4452026-07-29T01:14:34.844ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 362
4462026-07-29T01:14:34.844ZDEBGoximeter (clickhouse-client): unrolling 362 total samples collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
4472026-07-29T01:14:34.844ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
4482026-07-29T01:14:34.853ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 280 table_name = fields_i16
4492026-07-29T01:14:34.855ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 4 table_name = fields_ipaddr
4502026-07-29T01:14:34.857ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 803 table_name = fields_string
4512026-07-29T01:14:34.859ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 144 table_name = fields_u16
4522026-07-29T01:14:34.860ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 145 table_name = fields_u32
4532026-07-29T01:14:34.862ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 144 table_name = fields_u8
4542026-07-29T01:14:34.864ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 512 table_name = fields_uuid
4552026-07-29T01:14:34.865ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 4 table_name = measurements_bool
4562026-07-29T01:14:34.867ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 267 table_name = measurements_cumulativeu64
4572026-07-29T01:14:34.869ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 1 table_name = measurements_f64
4582026-07-29T01:14:34.870ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 90 table_name = measurements_u64
4592026-07-29T01:14:34.945ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
4602026-07-29T01:14:35.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4612026-07-29T01:14:35.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4622026-07-29T01:14:35.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4632026-07-29T01:14:35.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4642026-07-29T01:14:35.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4652026-07-29T01:14:35.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4662026-07-29T01:14:35.196ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4672026-07-29T01:14:35.196ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4682026-07-29T01:14:35.197ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4692026-07-29T01:14:35.545ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 44ef2097-07f5-4bb3-be17-ed18ff58a453 producer_ip = fd00:1122:3344:101::2 producer_port = 61629
4702026-07-29T01:14:35.545ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 44ef2097-07f5-4bb3-be17-ed18ff58a453 producer_ip = fd00:1122:3344:101::2 producer_port = 61629
4712026-07-29T01:14:35.555ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 44ef2097-07f5-4bb3-be17-ed18ff58a453 producer_ip = fd00:1122:3344:101::2 producer_port = 61629
4722026-07-29T01:14:36.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4732026-07-29T01:14:36.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4742026-07-29T01:14:36.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4752026-07-29T01:14:36.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4762026-07-29T01:14:36.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4772026-07-29T01:14:36.131ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4782026-07-29T01:14:36.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4792026-07-29T01:14:36.195ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4802026-07-29T01:14:36.197ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4812026-07-29T01:14:37.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4822026-07-29T01:14:37.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4832026-07-29T01:14:37.010ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4842026-07-29T01:14:37.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4852026-07-29T01:14:37.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4862026-07-29T01:14:37.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4872026-07-29T01:14:37.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4882026-07-29T01:14:37.195ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4892026-07-29T01:14:37.196ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4902026-07-29T01:14:38.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4912026-07-29T01:14:38.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4922026-07-29T01:14:38.012ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4932026-07-29T01:14:38.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4942026-07-29T01:14:38.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4952026-07-29T01:14:38.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4962026-07-29T01:14:38.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4972026-07-29T01:14:38.195ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4982026-07-29T01:14:38.196ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4992026-07-29T01:14:39.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5002026-07-29T01:14:39.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5012026-07-29T01:14:39.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5022026-07-29T01:14:39.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5032026-07-29T01:14:39.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5042026-07-29T01:14:39.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5052026-07-29T01:14:39.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5062026-07-29T01:14:39.195ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5072026-07-29T01:14:39.196ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5082026-07-29T01:14:39.844ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 231
5092026-07-29T01:14:39.844ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 231
5102026-07-29T01:14:39.844ZDEBGoximeter (clickhouse-client): unrolling 231 total samples collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
5112026-07-29T01:14:39.845ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
5122026-07-29T01:14:39.847ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:39.844874898Z } timeseries_name = http_service:request_latency_histogram
5132026-07-29T01:14:39.848ZDEBGoximeter (clickhouse-client): inserting 1 new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
5142026-07-29T01:14:39.852ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 102 table_name = fields_string
5152026-07-29T01:14:39.853ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 11 table_name = fields_u16
5162026-07-29T01:14:39.855ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 99 table_name = fields_uuid
5172026-07-29T01:14:39.857ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 160 table_name = measurements_cumulativeu64
5182026-07-29T01:14:39.859ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 11 table_name = measurements_histogramu64
5192026-07-29T01:14:39.860ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 60 table_name = measurements_u64
5202026-07-29T01:14:39.945ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
5212026-07-29T01:14:40.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5222026-07-29T01:14:40.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5232026-07-29T01:14:40.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5242026-07-29T01:14:40.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5252026-07-29T01:14:40.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5262026-07-29T01:14:40.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5272026-07-29T01:14:40.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5282026-07-29T01:14:40.195ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5292026-07-29T01:14:40.196ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5302026-07-29T01:14:40.935ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
5312026-07-29T01:14:40.936ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/4ff22963-5ae7-4fe3-a616-ec8cdb8979d5/producers?sort_by=id_ascending
5322026-07-29T01:14:40.938ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/4ff22963-5ae7-4fe3-a616-ec8cdb8979d5/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d999e75-606f-463d-9dab-abbb48502968", "content-length": "857", "date": "Wed, 29 Jul 2026 01:14:40 GMT"} })
5332026-07-29T01:14:40.939ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/4ff22963-5ae7-4fe3-a616-ec8cdb8979d5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDg3YTQ4ZS0yNzEwLTRlZjgtYjA1NC1lYmNjODdhYTc1YjgifX0%3D
5342026-07-29T01:14:40.942ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/4ff22963-5ae7-4fe3-a616-ec8cdb8979d5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDg3YTQ4ZS0yNzEwLTRlZjgtYjA1NC1lYmNjODdhYTc1YjgifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "357d79b3-aaa8-4f8a-8dc1-efc6441895af", "content-length": "29", "date": "Wed, 29 Jul 2026 01:14:40 GMT"} })
5352026-07-29T01:14:40.942ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 5 n_pruned_tasks = 0
5362026-07-29T01:14:41.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5372026-07-29T01:14:41.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5382026-07-29T01:14:41.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5392026-07-29T01:14:41.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5402026-07-29T01:14:41.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5412026-07-29T01:14:41.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5422026-07-29T01:14:41.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5432026-07-29T01:14:41.195ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5442026-07-29T01:14:41.196ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5452026-07-29T01:14:42.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5462026-07-29T01:14:42.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5472026-07-29T01:14:42.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5482026-07-29T01:14:42.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5492026-07-29T01:14:42.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5502026-07-29T01:14:42.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5512026-07-29T01:14:42.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5522026-07-29T01:14:42.195ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5532026-07-29T01:14:42.196ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5542026-07-29T01:14:42.715ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 42775a5e-8870-43bf-b621-14b499d6c082 producer_ip = fd00:1122:3344:101::2 producer_port = 37208
5552026-07-29T01:14:42.715ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 42775a5e-8870-43bf-b621-14b499d6c082 producer_ip = fd00:1122:3344:101::2 producer_port = 37208
5562026-07-29T01:14:42.723ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 42775a5e-8870-43bf-b621-14b499d6c082 producer_ip = fd00:1122:3344:101::2 producer_port = 37208
5572026-07-29T01:14:43.011ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5582026-07-29T01:14:43.011ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5592026-07-29T01:14:43.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5602026-07-29T01:14:43.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5612026-07-29T01:14:43.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5622026-07-29T01:14:43.133ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5632026-07-29T01:14:43.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5642026-07-29T01:14:43.195ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5652026-07-29T01:14:43.196ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5662026-07-29T01:14:44.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5672026-07-29T01:14:44.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5682026-07-29T01:14:44.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5692026-07-29T01:14:44.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5702026-07-29T01:14:44.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5712026-07-29T01:14:44.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5722026-07-29T01:14:44.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5732026-07-29T01:14:44.195ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5742026-07-29T01:14:44.196ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5752026-07-29T01:14:44.844ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 364
5762026-07-29T01:14:44.844ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 364
5772026-07-29T01:14:44.844ZDEBGoximeter (clickhouse-client): unrolling 364 total samples collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
5782026-07-29T01:14:44.845ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
5792026-07-29T01:14:44.857ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 280 table_name = fields_i16
5802026-07-29T01:14:44.859ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 4 table_name = fields_ipaddr
5812026-07-29T01:14:44.861ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 805 table_name = fields_string
5822026-07-29T01:14:44.863ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 144 table_name = fields_u16
5832026-07-29T01:14:44.866ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 145 table_name = fields_u32
5842026-07-29T01:14:44.868ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 144 table_name = fields_u8
5852026-07-29T01:14:44.870ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 512 table_name = fields_uuid
5862026-07-29T01:14:44.872ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 4 table_name = measurements_bool
5872026-07-29T01:14:44.875ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 267 table_name = measurements_cumulativeu64
5882026-07-29T01:14:44.877ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 1 table_name = measurements_f64
5892026-07-29T01:14:44.879ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 2 table_name = measurements_histogramu64
5902026-07-29T01:14:44.881ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 90 table_name = measurements_u64
5912026-07-29T01:14:44.945ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
5922026-07-29T01:14:45.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5932026-07-29T01:14:45.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5942026-07-29T01:14:45.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5952026-07-29T01:14:45.036ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 42775a5e-8870-43bf-b621-14b499d6c082 producer_ip = fd00:1122:3344:101::2 producer_port = 37208
5962026-07-29T01:14:45.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5972026-07-29T01:14:45.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5982026-07-29T01:14:45.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5992026-07-29T01:14:45.196ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6002026-07-29T01:14:45.196ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6012026-07-29T01:14:45.197ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6022026-07-29T01:14:45.545ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 44ef2097-07f5-4bb3-be17-ed18ff58a453 producer_ip = fd00:1122:3344:101::2 producer_port = 61629
6032026-07-29T01:14:45.545ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 44ef2097-07f5-4bb3-be17-ed18ff58a453 producer_ip = fd00:1122:3344:101::2 producer_port = 61629
6042026-07-29T01:14:45.546ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 44ef2097-07f5-4bb3-be17-ed18ff58a453 producer_ip = fd00:1122:3344:101::2 producer_port = 61629
6052026-07-29T01:14:46.011ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6062026-07-29T01:14:46.011ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6072026-07-29T01:14:46.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6082026-07-29T01:14:46.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6092026-07-29T01:14:46.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6102026-07-29T01:14:46.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6112026-07-29T01:14:46.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6122026-07-29T01:14:46.195ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6132026-07-29T01:14:46.196ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6142026-07-29T01:14:47.011ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6152026-07-29T01:14:47.011ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6162026-07-29T01:14:47.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6172026-07-29T01:14:47.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6182026-07-29T01:14:47.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6192026-07-29T01:14:47.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6202026-07-29T01:14:47.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6212026-07-29T01:14:47.195ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6222026-07-29T01:14:47.196ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6232026-07-29T01:14:48.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6242026-07-29T01:14:48.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6252026-07-29T01:14:48.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6262026-07-29T01:14:48.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6272026-07-29T01:14:48.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6282026-07-29T01:14:48.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6292026-07-29T01:14:48.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6302026-07-29T01:14:48.195ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6312026-07-29T01:14:48.196ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6322026-07-29T01:14:49.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6332026-07-29T01:14:49.011ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6342026-07-29T01:14:49.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6352026-07-29T01:14:49.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6362026-07-29T01:14:49.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6372026-07-29T01:14:49.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6382026-07-29T01:14:49.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6392026-07-29T01:14:49.195ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6402026-07-29T01:14:49.196ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6412026-07-29T01:14:49.844ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 233
6422026-07-29T01:14:49.844ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 233
6432026-07-29T01:14:49.844ZDEBGoximeter (clickhouse-client): unrolling 233 total samples collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
6442026-07-29T01:14:49.845ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
6452026-07-29T01:14:49.850ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 4 table_name = fields_ipaddr
6462026-07-29T01:14:49.851ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 104 table_name = fields_string
6472026-07-29T01:14:49.853ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 15 table_name = fields_u16
6482026-07-29T01:14:49.854ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 103 table_name = fields_uuid
6492026-07-29T01:14:49.856ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 162 table_name = measurements_cumulativeu64
6502026-07-29T01:14:49.858ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 11 table_name = measurements_histogramu64
6512026-07-29T01:14:49.859ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 60 table_name = measurements_u64
6522026-07-29T01:14:49.945ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
6532026-07-29T01:14:50.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6542026-07-29T01:14:50.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6552026-07-29T01:14:50.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6562026-07-29T01:14:50.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6572026-07-29T01:14:50.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6582026-07-29T01:14:50.133ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6592026-07-29T01:14:50.196ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6602026-07-29T01:14:50.196ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6612026-07-29T01:14:50.197ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6622026-07-29T01:14:51.011ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6632026-07-29T01:14:51.011ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6642026-07-29T01:14:51.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6652026-07-29T01:14:51.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6662026-07-29T01:14:51.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6672026-07-29T01:14:51.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6682026-07-29T01:14:51.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6692026-07-29T01:14:51.195ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6702026-07-29T01:14:51.196ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6712026-07-29T01:14:52.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6722026-07-29T01:14:52.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6732026-07-29T01:14:52.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6742026-07-29T01:14:52.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6752026-07-29T01:14:52.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6762026-07-29T01:14:52.131ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6772026-07-29T01:14:52.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6782026-07-29T01:14:52.196ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6792026-07-29T01:14:52.196ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6802026-07-29T01:14:52.716ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 42775a5e-8870-43bf-b621-14b499d6c082 producer_ip = fd00:1122:3344:101::2 producer_port = 37208
6812026-07-29T01:14:52.716ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 42775a5e-8870-43bf-b621-14b499d6c082 producer_ip = fd00:1122:3344:101::2 producer_port = 37208
6822026-07-29T01:14:52.723ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 42775a5e-8870-43bf-b621-14b499d6c082 producer_ip = fd00:1122:3344:101::2 producer_port = 37208
6832026-07-29T01:14:53.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6842026-07-29T01:14:53.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6852026-07-29T01:14:53.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6862026-07-29T01:14:53.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6872026-07-29T01:14:53.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6882026-07-29T01:14:53.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6892026-07-29T01:14:53.196ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6902026-07-29T01:14:53.196ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6912026-07-29T01:14:53.197ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6922026-07-29T01:14:54.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6932026-07-29T01:14:54.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6942026-07-29T01:14:54.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6952026-07-29T01:14:54.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6962026-07-29T01:14:54.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6972026-07-29T01:14:54.133ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6982026-07-29T01:14:54.196ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6992026-07-29T01:14:54.196ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7002026-07-29T01:14:54.197ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7012026-07-29T01:14:54.845ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 360
7022026-07-29T01:14:54.845ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 360
7032026-07-29T01:14:54.845ZDEBGoximeter (clickhouse-client): unrolling 360 total samples collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
7042026-07-29T01:14:54.845ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
7052026-07-29T01:14:54.853ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 280 table_name = fields_i16
7062026-07-29T01:14:54.855ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 801 table_name = fields_string
7072026-07-29T01:14:54.856ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 140 table_name = fields_u16
7082026-07-29T01:14:54.858ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 145 table_name = fields_u32
7092026-07-29T01:14:54.859ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 144 table_name = fields_u8
7102026-07-29T01:14:54.860ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 508 table_name = fields_uuid
7112026-07-29T01:14:54.862ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 4 table_name = measurements_bool
7122026-07-29T01:14:54.863ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 265 table_name = measurements_cumulativeu64
7132026-07-29T01:14:54.864ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 1 table_name = measurements_f64
7142026-07-29T01:14:54.865ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 90 table_name = measurements_u64
7152026-07-29T01:14:54.946ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
7162026-07-29T01:14:55.011ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7172026-07-29T01:14:55.011ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7182026-07-29T01:14:55.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7192026-07-29T01:14:55.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7202026-07-29T01:14:55.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7212026-07-29T01:14:55.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7222026-07-29T01:14:55.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7232026-07-29T01:14:55.195ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7242026-07-29T01:14:55.196ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7252026-07-29T01:14:55.545ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 44ef2097-07f5-4bb3-be17-ed18ff58a453 producer_ip = fd00:1122:3344:101::2 producer_port = 61629
7262026-07-29T01:14:55.546ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 44ef2097-07f5-4bb3-be17-ed18ff58a453 producer_ip = fd00:1122:3344:101::2 producer_port = 61629
7272026-07-29T01:14:55.547ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 44ef2097-07f5-4bb3-be17-ed18ff58a453 producer_ip = fd00:1122:3344:101::2 producer_port = 61629
7282026-07-29T01:14:55.936ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
7292026-07-29T01:14:55.936ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/4ff22963-5ae7-4fe3-a616-ec8cdb8979d5/producers?sort_by=id_ascending
7302026-07-29T01:14:55.939ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/4ff22963-5ae7-4fe3-a616-ec8cdb8979d5/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a8189f5-1c9f-4241-8b99-82d1298de215", "content-length": "1271", "date": "Wed, 29 Jul 2026 01:14:55 GMT"} })
7312026-07-29T01:14:55.939ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/4ff22963-5ae7-4fe3-a616-ec8cdb8979d5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWM5Zjg1Yy00Yjg1LTQyNzUtYWY4Yy1mMzkwMjliN2YzOGUifX0%3D
7322026-07-29T01:14:55.942ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/4ff22963-5ae7-4fe3-a616-ec8cdb8979d5/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWM5Zjg1Yy00Yjg1LTQyNzUtYWY4Yy1mMzkwMjliN2YzOGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddff1fdc-ff9c-41fe-8e7c-74e3a9f18ddf", "content-length": "29", "date": "Wed, 29 Jul 2026 01:14:55 GMT"} })
7332026-07-29T01:14:55.942ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:53103 collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 1f14d2b3-fdd7-4bc5-97a2-1d7d25fde44f
7342026-07-29T01:14:55.942ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:41737 collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 91282035-0273-4188-a9b4-a4f9c97f03d8
7352026-07-29T01:14:55.942ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:51790 collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = eec9f85c-4b85-4275-af8c-f39029b7f38e
7362026-07-29T01:14:55.943ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 8 n_pruned_tasks = 0
7372026-07-29T01:14:56.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7382026-07-29T01:14:56.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7392026-07-29T01:14:56.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7402026-07-29T01:14:56.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7412026-07-29T01:14:56.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7422026-07-29T01:14:56.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7432026-07-29T01:14:56.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7442026-07-29T01:14:56.195ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7452026-07-29T01:14:56.196ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7462026-07-29T01:14:56.843ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = eec9f85c-4b85-4275-af8c-f39029b7f38e producer_ip = fd00:1122:3344:101::c producer_port = 51790
7472026-07-29T01:14:56.843ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = eec9f85c-4b85-4275-af8c-f39029b7f38e producer_ip = fd00:1122:3344:101::c producer_port = 51790
7482026-07-29T01:14:56.846ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 8 producer_id = eec9f85c-4b85-4275-af8c-f39029b7f38e producer_ip = fd00:1122:3344:101::c producer_port = 51790
7492026-07-29T01:14:57.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7502026-07-29T01:14:57.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7512026-07-29T01:14:57.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7522026-07-29T01:14:57.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7532026-07-29T01:14:57.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7542026-07-29T01:14:57.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7552026-07-29T01:14:57.196ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7562026-07-29T01:14:57.196ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7572026-07-29T01:14:57.197ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7582026-07-29T01:14:58.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7592026-07-29T01:14:58.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7602026-07-29T01:14:58.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7612026-07-29T01:14:58.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7622026-07-29T01:14:58.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7632026-07-29T01:14:58.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7642026-07-29T01:14:58.196ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7652026-07-29T01:14:58.196ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7662026-07-29T01:14:58.197ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7672026-07-29T01:14:59.010ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7682026-07-29T01:14:59.010ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7692026-07-29T01:14:59.011ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7702026-07-29T01:14:59.130ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7712026-07-29T01:14:59.130ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7722026-07-29T01:14:59.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7732026-07-29T01:14:59.196ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7742026-07-29T01:14:59.196ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7752026-07-29T01:14:59.197ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7762026-07-29T01:14:59.844ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 239
7772026-07-29T01:14:59.844ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_samples = 239
7782026-07-29T01:14:59.845ZDEBGoximeter (clickhouse-client): unrolling 239 total samples collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
7792026-07-29T01:14:59.845ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
7802026-07-29T01:14:59.848ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:59.845141449Z } timeseries_name = collection_target:cpus_provisioned
7812026-07-29T01:14:59.848ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:59.845143049Z } timeseries_name = collection_target:ram_provisioned
7822026-07-29T01:14:59.848ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-29T01:14:59.845145089Z } timeseries_name = collection_target:virtual_disk_space_provisioned
7832026-07-29T01:14:59.849ZDEBGoximeter (clickhouse-client): inserting 3 new timeseries schema collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a
7842026-07-29T01:14:59.852ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 106 table_name = fields_string
7852026-07-29T01:14:59.853ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 13 table_name = fields_u16
7862026-07-29T01:14:59.854ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 107 table_name = fields_uuid
7872026-07-29T01:14:59.855ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 160 table_name = measurements_cumulativeu64
7882026-07-29T01:14:59.857ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 13 table_name = measurements_histogramu64
7892026-07-29T01:14:59.858ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 6 table_name = measurements_i64
7902026-07-29T01:14:59.859ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d id = 53a82096-d3a8-443c-b715-9e55d35d413a n_rows = 60 table_name = measurements_u64
7912026-07-29T01:14:59.946ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
7922026-07-29T01:15:00.011ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7932026-07-29T01:15:00.011ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7942026-07-29T01:15:00.012ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = e1c07fad-58e0-4e46-8e7e-8b0f32c05b93 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7952026-07-29T01:15:00.131ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7962026-07-29T01:15:00.131ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7972026-07-29T01:15:00.132ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = ed87a48e-2710-4ef8-b054-ebcc87aa75b8 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7982026-07-29T01:15:00.195ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7992026-07-29T01:15:00.195ZDEBGoximeter (collection-task): collecting from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8002026-07-29T01:15:00.196ZDEBGoximeter (collection-task): collected results from producer collector_id = 4ff22963-5ae7-4fe3-a616-ec8cdb8979d5 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 3a949c8d-0c9c-4e51-a0db-fbe1bf055f38 producer_ip = fd00:1122:3344:101::2 producer_port = 8001