Max level shown:
1 [ Jul 23 02:28:21 Enabled. ]
2 [ Jul 23 02:28:21 Rereading configuration. ]
3 [ Jul 23 02:28:22 Rereading configuration. ]
4 [ Jul 23 02:28:25 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id 57167f76-7ab5-441b-9c48-8f6f6c594ad2 &"). ]
5 [ Jul 23 02:28:25 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-07-23T02:28:25.723ZDEBGoximeter: registered DTrace probes
82026-07-23T02:28:25.725ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:299
92026-07-23T02:28:25.725ZDEBGoximeter: creating ClickHouse client
102026-07-23T02:28:25.734ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
112026-07-23T02:28:42.805ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:888 id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
122026-07-23T02:28:42.809ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d
132026-07-23T02:28:42.809ZINFOoximeter (clickhouse-client): reading db version collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:788 id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
142026-07-23T02:28:42.811ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:888 id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
152026-07-23T02:28:42.811ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:793 id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 version = 0
162026-07-23T02:28:42.811ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:798 id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
172026-07-23T02:28:42.811ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
182026-07-23T02:28:43.012ZINFOoximeter (clickhouse-client): inserting current version collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:819 id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 version = 14
192026-07-23T02:28:43.065ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = ae6a3654-2528-476e-ab67-88386e70bd04
202026-07-23T02:28:43.116ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-07-23T02:28:43.117ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-07-23T02:28:43.117ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-07-23T02:28:43.117ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-07-23T02:28:43.117ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:335 local_addr = [fd00:1122:3344:101::d]:12223
252026-07-23T02:28:43.121ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-07-23T02:28:43.121ZDEBGoximeter: registered USDT probes
272026-07-23T02:28:43.121ZDEBGoximeter: contacting nexus
282026-07-23T02:28:43.182ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
292026-07-23T02:28:43.202ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "5346cb3c-6085-4479-8e70-4c451854daff", "date": "Thu, 23 Jul 2026 02:28:43 GMT"} })
302026-07-23T02:28:43.203ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:431 id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2
312026-07-23T02:28:43.203ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:626
322026-07-23T02:28:43.204ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
332026-07-23T02:28:43.209ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/57167f76-7ab5-441b-9c48-8f6f6c594ad2/producers?sort_by=id_ascending
342026-07-23T02:28:43.212ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/57167f76-7ab5-441b-9c48-8f6f6c594ad2/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8f5f0c5-b15d-49d6-8a3e-67de2b73d0e7", "content-length": "29", "date": "Thu, 23 Jul 2026 02:28:43 GMT"} })
352026-07-23T02:28:43.212ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 0 n_pruned_tasks = 0
362026-07-23T02:28:48.070ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 4
372026-07-23T02:28:48.070ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 4
382026-07-23T02:28:48.073ZDEBGoximeter (clickhouse-client): unrolling 4 total samples collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
392026-07-23T02:28:48.076ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
402026-07-23T02:28:48.077ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:database_queue_depth"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "collector_sink", field_type: String, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:28:48.076049938Z } timeseries_name = oximeter_collector:database_queue_depth
412026-07-23T02:28:48.077ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:database_samples_dropped"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "collector_sink", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:28:48.076046048Z } timeseries_name = oximeter_collector:database_samples_dropped
422026-07-23T02:28:48.077ZDEBGoximeter (clickhouse-client): inserting 2 new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
432026-07-23T02:28:48.088ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 4 table_name = fields_ipaddr
442026-07-23T02:28:48.090ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 4 table_name = fields_string
452026-07-23T02:28:48.092ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 4 table_name = fields_u16
462026-07-23T02:28:48.094ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 4 table_name = fields_uuid
472026-07-23T02:28:48.096ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 2 table_name = measurements_cumulativeu64
482026-07-23T02:28:48.103ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 2 table_name = measurements_histogramu64
492026-07-23T02:28:48.173ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
502026-07-23T02:28:53.070ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d
512026-07-23T02:28:53.070ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d
522026-07-23T02:28:58.070ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d
532026-07-23T02:28:58.070ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d
542026-07-23T02:28:58.204ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
552026-07-23T02:28:58.204ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/57167f76-7ab5-441b-9c48-8f6f6c594ad2/producers?sort_by=id_ascending
562026-07-23T02:28:58.217ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/57167f76-7ab5-441b-9c48-8f6f6c594ad2/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fd5d5f5-eae6-42ac-a2a7-6081edba2264", "content-length": "997", "date": "Thu, 23 Jul 2026 02:28:58 GMT"} })
572026-07-23T02:28:58.219ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/57167f76-7ab5-441b-9c48-8f6f6c594ad2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkMDEzMzc1MC1lN2I3LTQ1NTgtODFmNC03N2FlZTU5NzQyOTcifX0%3D
582026-07-23T02:28:58.222ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/57167f76-7ab5-441b-9c48-8f6f6c594ad2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkMDEzMzc1MC1lN2I3LTQ1NTgtODFmNC03N2FlZTU5NzQyOTcifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "a283519e-3499-4038-9a60-d13780afef49", "content-length": "29", "date": "Thu, 23 Jul 2026 02:28:58 GMT"} })
592026-07-23T02:28:58.222ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56
602026-07-23T02:28:58.222ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:46309 collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 4486e5fb-a1cd-40af-9c40-c8bb59e9b9a6
612026-07-23T02:28:58.222ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:52274 collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 5a587403-4922-4caf-9b07-c9826344fc11
622026-07-23T02:28:58.222ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148
632026-07-23T02:28:58.222ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:52550 collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = aa18ee5f-63ba-4bde-b1dd-20db9b63b372
642026-07-23T02:28:58.222ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:41495 collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = d0133750-e7b7-4558-81f4-77aee5974297
652026-07-23T02:28:58.222ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 6 n_pruned_tasks = 0
662026-07-23T02:28:58.273ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
672026-07-23T02:28:59.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
682026-07-23T02:28:59.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
692026-07-23T02:28:59.019ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
702026-07-23T02:28:59.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
712026-07-23T02:28:59.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
722026-07-23T02:28:59.114ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
732026-07-23T02:29:00.014ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
742026-07-23T02:29:00.014ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
752026-07-23T02:29:00.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
762026-07-23T02:29:00.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
772026-07-23T02:29:00.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
782026-07-23T02:29:00.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
792026-07-23T02:29:00.352ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 4486e5fb-a1cd-40af-9c40-c8bb59e9b9a6 producer_ip = fd00:1122:3344:101::a producer_port = 46309
802026-07-23T02:29:00.352ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 4486e5fb-a1cd-40af-9c40-c8bb59e9b9a6 producer_ip = fd00:1122:3344:101::a producer_port = 46309
812026-07-23T02:29:00.372ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 33 producer_id = 4486e5fb-a1cd-40af-9c40-c8bb59e9b9a6 producer_ip = fd00:1122:3344:101::a producer_port = 46309
822026-07-23T02:29:01.014ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
832026-07-23T02:29:01.014ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
842026-07-23T02:29:01.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
852026-07-23T02:29:01.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
862026-07-23T02:29:01.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
872026-07-23T02:29:01.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
882026-07-23T02:29:02.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
892026-07-23T02:29:02.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
902026-07-23T02:29:02.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
912026-07-23T02:29:02.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
922026-07-23T02:29:02.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
932026-07-23T02:29:02.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
942026-07-23T02:29:03.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
952026-07-23T02:29:03.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
962026-07-23T02:29:03.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
972026-07-23T02:29:03.032ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = aa18ee5f-63ba-4bde-b1dd-20db9b63b372 producer_ip = fd00:1122:3344:101::2 producer_port = 52550
982026-07-23T02:29:03.032ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = aa18ee5f-63ba-4bde-b1dd-20db9b63b372 producer_ip = fd00:1122:3344:101::2 producer_port = 52550
992026-07-23T02:29:03.039ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = aa18ee5f-63ba-4bde-b1dd-20db9b63b372 producer_ip = fd00:1122:3344:101::2 producer_port = 52550
1002026-07-23T02:29:03.071ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 192
1012026-07-23T02:29:03.071ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 192
1022026-07-23T02:29:03.071ZDEBGoximeter (clickhouse-client): unrolling 192 total samples collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
1032026-07-23T02:29:03.071ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
1042026-07-23T02:29:03.075ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071355858Z } timeseries_name = collection_target:cpus_provisioned
1052026-07-23T02:29:03.075ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071356998Z } timeseries_name = collection_target:ram_provisioned
1062026-07-23T02:29:03.075ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071358458Z } timeseries_name = collection_target:virtual_disk_space_provisioned
1072026-07-23T02:29:03.075ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("database_transaction:retry_data"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "attempt", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071362258Z } timeseries_name = database_transaction:retry_data
1082026-07-23T02:29:03.075ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071304127Z } timeseries_name = ddm_router:originated_tunnel_endpoints
1092026-07-23T02:29:03.075ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071302277Z } timeseries_name = ddm_router:originated_underlay_prefixes
1102026-07-23T02:29:03.075ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071312378Z } timeseries_name = ddm_session:advertisements_received
1112026-07-23T02:29:03.075ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071310407Z } timeseries_name = ddm_session:advertisements_sent
1122026-07-23T02:29:03.075ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071327188Z } timeseries_name = ddm_session:imported_tunnel_endpoints
1132026-07-23T02:29:03.075ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071325268Z } timeseries_name = ddm_session:imported_underlay_prefixes
1142026-07-23T02:29:03.075ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071315667Z } timeseries_name = ddm_session:peer_address_changes
1152026-07-23T02:29:03.075ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071314178Z } timeseries_name = ddm_session:peer_expirations
1162026-07-23T02:29:03.076ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071317567Z } timeseries_name = ddm_session:peer_sessions_established
1172026-07-23T02:29:03.076ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071308567Z } timeseries_name = ddm_session:solicitations_received
1182026-07-23T02:29:03.076ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071306438Z } timeseries_name = ddm_session:solicitations_sent
1192026-07-23T02:29:03.076ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071323478Z } timeseries_name = ddm_session:update_send_fail
1202026-07-23T02:29:03.076ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071322028Z } timeseries_name = ddm_session:updates_received
1212026-07-23T02:29:03.076ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071319367Z } timeseries_name = ddm_session:updates_sent
1222026-07-23T02:29:03.076ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071349278Z } timeseries_name = http_service:request_latency_histogram
1232026-07-23T02:29:03.076ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071338828Z } timeseries_name = mg_lower:routes_blocked_by_link_state
1242026-07-23T02:29:03.076ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071295837Z } timeseries_name = oximeter_collector:collections
1252026-07-23T02:29:03.076ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:samples_collected"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071299637Z } timeseries_name = oximeter_collector:samples_collected
1262026-07-23T02:29:03.076ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071336198Z } timeseries_name = static_routing_config:static_nexthops
1272026-07-23T02:29:03.076ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071334558Z } timeseries_name = static_routing_config:static_routes
1282026-07-23T02:29:03.076ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:03.071337368Z } timeseries_name = switch_rib:active_routes
1292026-07-23T02:29:03.077ZDEBGoximeter (clickhouse-client): inserting 25 new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
1302026-07-23T02:29:03.080ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 4 table_name = fields_ipaddr
1312026-07-23T02:29:03.083ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 119 table_name = fields_string
1322026-07-23T02:29:03.084ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 35 table_name = fields_u16
1332026-07-23T02:29:03.085ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 1 table_name = fields_u32
1342026-07-23T02:29:03.087ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 102 table_name = fields_uuid
1352026-07-23T02:29:03.088ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 110 table_name = measurements_cumulativeu64
1362026-07-23T02:29:03.089ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 1 table_name = measurements_f64
1372026-07-23T02:29:03.091ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 31 table_name = measurements_histogramu64
1382026-07-23T02:29:03.092ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 12 table_name = measurements_i64
1392026-07-23T02:29:03.093ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 38 table_name = measurements_u64
1402026-07-23T02:29:03.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1412026-07-23T02:29:03.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1422026-07-23T02:29:03.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1432026-07-23T02:29:03.172ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1442026-07-23T02:29:03.251ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = d0133750-e7b7-4558-81f4-77aee5974297 producer_ip = fd00:1122:3344:101::2 producer_port = 41495
1452026-07-23T02:29:03.251ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = d0133750-e7b7-4558-81f4-77aee5974297 producer_ip = fd00:1122:3344:101::2 producer_port = 41495
1462026-07-23T02:29:03.270ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = d0133750-e7b7-4558-81f4-77aee5974297 producer_ip = fd00:1122:3344:101::2 producer_port = 41495
1472026-07-23T02:29:04.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1482026-07-23T02:29:04.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1492026-07-23T02:29:04.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1502026-07-23T02:29:04.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1512026-07-23T02:29:04.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1522026-07-23T02:29:04.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1532026-07-23T02:29:04.723ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 5a587403-4922-4caf-9b07-c9826344fc11 producer_ip = fd00:1122:3344:101::b producer_port = 52274
1542026-07-23T02:29:04.723ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 5a587403-4922-4caf-9b07-c9826344fc11 producer_ip = fd00:1122:3344:101::b producer_port = 52274
1552026-07-23T02:29:04.741ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 5a587403-4922-4caf-9b07-c9826344fc11 producer_ip = fd00:1122:3344:101::b producer_port = 52274
1562026-07-23T02:29:05.014ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1572026-07-23T02:29:05.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1582026-07-23T02:29:05.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1592026-07-23T02:29:05.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1602026-07-23T02:29:05.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1612026-07-23T02:29:05.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1622026-07-23T02:29:06.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1632026-07-23T02:29:06.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1642026-07-23T02:29:06.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1652026-07-23T02:29:06.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1662026-07-23T02:29:06.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1672026-07-23T02:29:06.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1682026-07-23T02:29:07.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1692026-07-23T02:29:07.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1702026-07-23T02:29:07.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1712026-07-23T02:29:07.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1722026-07-23T02:29:07.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1732026-07-23T02:29:07.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1742026-07-23T02:29:08.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1752026-07-23T02:29:08.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1762026-07-23T02:29:08.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1772026-07-23T02:29:08.070ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 292
1782026-07-23T02:29:08.070ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 292
1792026-07-23T02:29:08.070ZDEBGoximeter (clickhouse-client): unrolling 292 total samples collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
1802026-07-23T02:29:08.071ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
1812026-07-23T02:29:08.102ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:08.070940788Z } timeseries_name = dendrite:sample_collection_duration
1822026-07-23T02:29:08.102ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:08.070878577Z } timeseries_name = switch_data_link:link_enabled
1832026-07-23T02:29:08.102ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:08.070883137Z } timeseries_name = switch_data_link:link_up
1842026-07-23T02:29:08.103ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:08.070886957Z } timeseries_name = switch_table:capacity
1852026-07-23T02:29:08.103ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:08.070900368Z } timeseries_name = switch_table:collisions
1862026-07-23T02:29:08.103ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:08.070906418Z } timeseries_name = switch_table:delete_misses
1872026-07-23T02:29:08.103ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:08.070895408Z } timeseries_name = switch_table:deletes
1882026-07-23T02:29:08.103ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:08.070909418Z } timeseries_name = switch_table:exhaustion
1892026-07-23T02:29:08.103ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:08.070892728Z } timeseries_name = switch_table:inserts
1902026-07-23T02:29:08.103ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:08.070890068Z } timeseries_name = switch_table:occupancy
1912026-07-23T02:29:08.103ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:08.070904088Z } timeseries_name = switch_table:update_misses
1922026-07-23T02:29:08.103ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:08.070898138Z } timeseries_name = switch_table:updates
1932026-07-23T02:29:08.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1942026-07-23T02:29:08.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1952026-07-23T02:29:08.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1962026-07-23T02:29:08.109ZDEBGoximeter (clickhouse-client): inserting 12 new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
1972026-07-23T02:29:08.113ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 280 table_name = fields_i16
1982026-07-23T02:29:08.115ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 779 table_name = fields_string
1992026-07-23T02:29:08.116ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 142 table_name = fields_u16
2002026-07-23T02:29:08.117ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 145 table_name = fields_u32
2012026-07-23T02:29:08.118ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 144 table_name = fields_u8
2022026-07-23T02:29:08.120ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 482 table_name = fields_uuid
2032026-07-23T02:29:08.121ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 4 table_name = measurements_bool
2042026-07-23T02:29:08.123ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 215 table_name = measurements_cumulativeu64
2052026-07-23T02:29:08.124ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 1 table_name = measurements_f64
2062026-07-23T02:29:08.126ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 2 table_name = measurements_histogramu64
2072026-07-23T02:29:08.127ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 70 table_name = measurements_u64
2082026-07-23T02:29:08.171ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2092026-07-23T02:29:09.014ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2102026-07-23T02:29:09.014ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2112026-07-23T02:29:09.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2122026-07-23T02:29:09.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2132026-07-23T02:29:09.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2142026-07-23T02:29:09.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2152026-07-23T02:29:09.467ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = d0133750-e7b7-4558-81f4-77aee5974297 producer_ip = fd00:1122:3344:101::2 producer_port = 41495
2162026-07-23T02:29:10.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2172026-07-23T02:29:10.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2182026-07-23T02:29:10.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2192026-07-23T02:29:10.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2202026-07-23T02:29:10.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2212026-07-23T02:29:10.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2222026-07-23T02:29:10.352ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 4486e5fb-a1cd-40af-9c40-c8bb59e9b9a6 producer_ip = fd00:1122:3344:101::a producer_port = 46309
2232026-07-23T02:29:10.352ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 4486e5fb-a1cd-40af-9c40-c8bb59e9b9a6 producer_ip = fd00:1122:3344:101::a producer_port = 46309
2242026-07-23T02:29:10.354ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 33 producer_id = 4486e5fb-a1cd-40af-9c40-c8bb59e9b9a6 producer_ip = fd00:1122:3344:101::a producer_port = 46309
2252026-07-23T02:29:10.956ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 4486e5fb-a1cd-40af-9c40-c8bb59e9b9a6 producer_ip = fd00:1122:3344:101::a producer_port = 46309
2262026-07-23T02:29:11.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2272026-07-23T02:29:11.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2282026-07-23T02:29:11.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2292026-07-23T02:29:11.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2302026-07-23T02:29:11.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2312026-07-23T02:29:11.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2322026-07-23T02:29:12.014ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2332026-07-23T02:29:12.014ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2342026-07-23T02:29:12.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2352026-07-23T02:29:12.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2362026-07-23T02:29:12.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2372026-07-23T02:29:12.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2382026-07-23T02:29:13.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2392026-07-23T02:29:13.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2402026-07-23T02:29:13.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2412026-07-23T02:29:13.031ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = aa18ee5f-63ba-4bde-b1dd-20db9b63b372 producer_ip = fd00:1122:3344:101::2 producer_port = 52550
2422026-07-23T02:29:13.031ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = aa18ee5f-63ba-4bde-b1dd-20db9b63b372 producer_ip = fd00:1122:3344:101::2 producer_port = 52550
2432026-07-23T02:29:13.033ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = aa18ee5f-63ba-4bde-b1dd-20db9b63b372 producer_ip = fd00:1122:3344:101::2 producer_port = 52550
2442026-07-23T02:29:13.070ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 198
2452026-07-23T02:29:13.070ZDEBGoximeter (clickhouse-client): unrolling 198 total samples collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
2462026-07-23T02:29:13.070ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 198
2472026-07-23T02:29:13.071ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
2482026-07-23T02:29:13.083ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 8 table_name = fields_ipaddr
2492026-07-23T02:29:13.085ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 134 table_name = fields_string
2502026-07-23T02:29:13.086ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 46 table_name = fields_u16
2512026-07-23T02:29:13.087ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 111 table_name = fields_uuid
2522026-07-23T02:29:13.088ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 114 table_name = measurements_cumulativeu64
2532026-07-23T02:29:13.090ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 38 table_name = measurements_histogramu64
2542026-07-23T02:29:13.091ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 6 table_name = measurements_i64
2552026-07-23T02:29:13.092ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 40 table_name = measurements_u64
2562026-07-23T02:29:13.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2572026-07-23T02:29:13.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2582026-07-23T02:29:13.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2592026-07-23T02:29:13.171ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2602026-07-23T02:29:13.205ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
2612026-07-23T02:29:13.205ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/57167f76-7ab5-441b-9c48-8f6f6c594ad2/producers?sort_by=id_ascending
2622026-07-23T02:29:13.208ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/57167f76-7ab5-441b-9c48-8f6f6c594ad2/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "578a186f-f3f7-4a31-9cea-dee966d29d63", "content-length": "1133", "date": "Thu, 23 Jul 2026 02:29:13 GMT"} })
2632026-07-23T02:29:13.208ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/57167f76-7ab5-441b-9c48-8f6f6c594ad2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkMDEzMzc1MC1lN2I3LTQ1NTgtODFmNC03N2FlZTU5NzQyOTcifX0%3D
2642026-07-23T02:29:13.215ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/57167f76-7ab5-441b-9c48-8f6f6c594ad2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkMDEzMzc1MC1lN2I3LTQ1NTgtODFmNC03N2FlZTU5NzQyOTcifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bf2a795-5c24-4273-9483-0de1050e04e4", "content-length": "29", "date": "Thu, 23 Jul 2026 02:29:13 GMT"} })
2652026-07-23T02:29:13.215ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395
2662026-07-23T02:29:13.215ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 7 n_pruned_tasks = 0
2672026-07-23T02:29:13.250ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = d0133750-e7b7-4558-81f4-77aee5974297 producer_ip = fd00:1122:3344:101::2 producer_port = 41495
2682026-07-23T02:29:13.250ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = d0133750-e7b7-4558-81f4-77aee5974297 producer_ip = fd00:1122:3344:101::2 producer_port = 41495
2692026-07-23T02:29:13.258ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = d0133750-e7b7-4558-81f4-77aee5974297 producer_ip = fd00:1122:3344:101::2 producer_port = 41495
2702026-07-23T02:29:13.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2712026-07-23T02:29:13.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2722026-07-23T02:29:13.557ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2732026-07-23T02:29:14.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2742026-07-23T02:29:14.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2752026-07-23T02:29:14.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2762026-07-23T02:29:14.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2772026-07-23T02:29:14.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2782026-07-23T02:29:14.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2792026-07-23T02:29:14.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2802026-07-23T02:29:14.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2812026-07-23T02:29:14.551ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2822026-07-23T02:29:14.723ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 5a587403-4922-4caf-9b07-c9826344fc11 producer_ip = fd00:1122:3344:101::b producer_port = 52274
2832026-07-23T02:29:14.723ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 5a587403-4922-4caf-9b07-c9826344fc11 producer_ip = fd00:1122:3344:101::b producer_port = 52274
2842026-07-23T02:29:14.723ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 5a587403-4922-4caf-9b07-c9826344fc11 producer_ip = fd00:1122:3344:101::b producer_port = 52274
2852026-07-23T02:29:15.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2862026-07-23T02:29:15.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2872026-07-23T02:29:15.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2882026-07-23T02:29:15.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2892026-07-23T02:29:15.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2902026-07-23T02:29:15.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2912026-07-23T02:29:15.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2922026-07-23T02:29:15.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2932026-07-23T02:29:15.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2942026-07-23T02:29:16.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2952026-07-23T02:29:16.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2962026-07-23T02:29:16.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2972026-07-23T02:29:16.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2982026-07-23T02:29:16.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2992026-07-23T02:29:16.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3002026-07-23T02:29:16.548ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3012026-07-23T02:29:16.548ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3022026-07-23T02:29:16.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3032026-07-23T02:29:17.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3042026-07-23T02:29:17.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3052026-07-23T02:29:17.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3062026-07-23T02:29:17.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3072026-07-23T02:29:17.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3082026-07-23T02:29:17.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3092026-07-23T02:29:17.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3102026-07-23T02:29:17.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3112026-07-23T02:29:17.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3122026-07-23T02:29:18.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3132026-07-23T02:29:18.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3142026-07-23T02:29:18.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3152026-07-23T02:29:18.071ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 362
3162026-07-23T02:29:18.071ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 362
3172026-07-23T02:29:18.071ZDEBGoximeter (clickhouse-client): unrolling 362 total samples collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
3182026-07-23T02:29:18.071ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
3192026-07-23T02:29:18.080ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 280 table_name = fields_i16
3202026-07-23T02:29:18.082ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 805 table_name = fields_string
3212026-07-23T02:29:18.083ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 142 table_name = fields_u16
3222026-07-23T02:29:18.084ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 145 table_name = fields_u32
3232026-07-23T02:29:18.085ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 144 table_name = fields_u8
3242026-07-23T02:29:18.087ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 510 table_name = fields_uuid
3252026-07-23T02:29:18.088ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 4 table_name = measurements_bool
3262026-07-23T02:29:18.089ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 265 table_name = measurements_cumulativeu64
3272026-07-23T02:29:18.091ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 1 table_name = measurements_f64
3282026-07-23T02:29:18.092ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 2 table_name = measurements_histogramu64
3292026-07-23T02:29:18.093ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 90 table_name = measurements_u64
3302026-07-23T02:29:18.097ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3312026-07-23T02:29:18.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3322026-07-23T02:29:18.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3332026-07-23T02:29:18.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3342026-07-23T02:29:18.172ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
3352026-07-23T02:29:18.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3362026-07-23T02:29:18.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3372026-07-23T02:29:18.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3382026-07-23T02:29:19.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3392026-07-23T02:29:19.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3402026-07-23T02:29:19.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3412026-07-23T02:29:19.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3422026-07-23T02:29:19.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3432026-07-23T02:29:19.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3442026-07-23T02:29:19.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3452026-07-23T02:29:19.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3462026-07-23T02:29:19.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3472026-07-23T02:29:20.014ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3482026-07-23T02:29:20.014ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3492026-07-23T02:29:20.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3502026-07-23T02:29:20.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3512026-07-23T02:29:20.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3522026-07-23T02:29:20.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3532026-07-23T02:29:20.352ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 4486e5fb-a1cd-40af-9c40-c8bb59e9b9a6 producer_ip = fd00:1122:3344:101::a producer_port = 46309
3542026-07-23T02:29:20.352ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 4486e5fb-a1cd-40af-9c40-c8bb59e9b9a6 producer_ip = fd00:1122:3344:101::a producer_port = 46309
3552026-07-23T02:29:20.354ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 4486e5fb-a1cd-40af-9c40-c8bb59e9b9a6 producer_ip = fd00:1122:3344:101::a producer_port = 46309
3562026-07-23T02:29:20.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3572026-07-23T02:29:20.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3582026-07-23T02:29:20.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3592026-07-23T02:29:21.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3602026-07-23T02:29:21.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3612026-07-23T02:29:21.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3622026-07-23T02:29:21.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3632026-07-23T02:29:21.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3642026-07-23T02:29:21.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3652026-07-23T02:29:21.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3662026-07-23T02:29:21.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3672026-07-23T02:29:21.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3682026-07-23T02:29:22.014ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3692026-07-23T02:29:22.014ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3702026-07-23T02:29:22.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3712026-07-23T02:29:22.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3722026-07-23T02:29:22.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3732026-07-23T02:29:22.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3742026-07-23T02:29:22.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3752026-07-23T02:29:22.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3762026-07-23T02:29:22.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3772026-07-23T02:29:23.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3782026-07-23T02:29:23.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3792026-07-23T02:29:23.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3802026-07-23T02:29:23.032ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = aa18ee5f-63ba-4bde-b1dd-20db9b63b372 producer_ip = fd00:1122:3344:101::2 producer_port = 52550
3812026-07-23T02:29:23.032ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = aa18ee5f-63ba-4bde-b1dd-20db9b63b372 producer_ip = fd00:1122:3344:101::2 producer_port = 52550
3822026-07-23T02:29:23.034ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = aa18ee5f-63ba-4bde-b1dd-20db9b63b372 producer_ip = fd00:1122:3344:101::2 producer_port = 52550
3832026-07-23T02:29:23.070ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 260
3842026-07-23T02:29:23.070ZDEBGoximeter (clickhouse-client): unrolling 260 total samples collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
3852026-07-23T02:29:23.070ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 260
3862026-07-23T02:29:23.071ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
3872026-07-23T02:29:23.077ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 4 table_name = fields_ipaddr
3882026-07-23T02:29:23.078ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 158 table_name = fields_string
3892026-07-23T02:29:23.079ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 42 table_name = fields_u16
3902026-07-23T02:29:23.080ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 130 table_name = fields_uuid
3912026-07-23T02:29:23.082ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 162 table_name = measurements_cumulativeu64
3922026-07-23T02:29:23.086ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 38 table_name = measurements_histogramu64
3932026-07-23T02:29:23.087ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 60 table_name = measurements_u64
3942026-07-23T02:29:23.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3952026-07-23T02:29:23.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3962026-07-23T02:29:23.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3972026-07-23T02:29:23.172ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
3982026-07-23T02:29:23.251ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = d0133750-e7b7-4558-81f4-77aee5974297 producer_ip = fd00:1122:3344:101::2 producer_port = 41495
3992026-07-23T02:29:23.251ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = d0133750-e7b7-4558-81f4-77aee5974297 producer_ip = fd00:1122:3344:101::2 producer_port = 41495
4002026-07-23T02:29:23.259ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = d0133750-e7b7-4558-81f4-77aee5974297 producer_ip = fd00:1122:3344:101::2 producer_port = 41495
4012026-07-23T02:29:23.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4022026-07-23T02:29:23.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4032026-07-23T02:29:23.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4042026-07-23T02:29:24.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4052026-07-23T02:29:24.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4062026-07-23T02:29:24.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4072026-07-23T02:29:24.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4082026-07-23T02:29:24.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4092026-07-23T02:29:24.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4102026-07-23T02:29:24.548ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4112026-07-23T02:29:24.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4122026-07-23T02:29:24.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4132026-07-23T02:29:24.723ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 5a587403-4922-4caf-9b07-c9826344fc11 producer_ip = fd00:1122:3344:101::b producer_port = 52274
4142026-07-23T02:29:24.723ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 5a587403-4922-4caf-9b07-c9826344fc11 producer_ip = fd00:1122:3344:101::b producer_port = 52274
4152026-07-23T02:29:24.724ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 5a587403-4922-4caf-9b07-c9826344fc11 producer_ip = fd00:1122:3344:101::b producer_port = 52274
4162026-07-23T02:29:25.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4172026-07-23T02:29:25.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4182026-07-23T02:29:25.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4192026-07-23T02:29:25.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4202026-07-23T02:29:25.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4212026-07-23T02:29:25.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4222026-07-23T02:29:25.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4232026-07-23T02:29:25.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4242026-07-23T02:29:25.551ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4252026-07-23T02:29:26.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4262026-07-23T02:29:26.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4272026-07-23T02:29:26.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4282026-07-23T02:29:26.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4292026-07-23T02:29:26.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4302026-07-23T02:29:26.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4312026-07-23T02:29:26.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4322026-07-23T02:29:26.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4332026-07-23T02:29:26.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4342026-07-23T02:29:27.014ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4352026-07-23T02:29:27.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4362026-07-23T02:29:27.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4372026-07-23T02:29:27.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4382026-07-23T02:29:27.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4392026-07-23T02:29:27.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4402026-07-23T02:29:27.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4412026-07-23T02:29:27.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4422026-07-23T02:29:27.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4432026-07-23T02:29:28.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4442026-07-23T02:29:28.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4452026-07-23T02:29:28.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4462026-07-23T02:29:28.071ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 362
4472026-07-23T02:29:28.071ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 362
4482026-07-23T02:29:28.071ZDEBGoximeter (clickhouse-client): unrolling 362 total samples collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
4492026-07-23T02:29:28.072ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
4502026-07-23T02:29:28.079ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 280 table_name = fields_i16
4512026-07-23T02:29:28.081ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 805 table_name = fields_string
4522026-07-23T02:29:28.082ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 142 table_name = fields_u16
4532026-07-23T02:29:28.083ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 145 table_name = fields_u32
4542026-07-23T02:29:28.085ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 144 table_name = fields_u8
4552026-07-23T02:29:28.086ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 510 table_name = fields_uuid
4562026-07-23T02:29:28.087ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 4 table_name = measurements_bool
4572026-07-23T02:29:28.088ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 265 table_name = measurements_cumulativeu64
4582026-07-23T02:29:28.089ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 1 table_name = measurements_f64
4592026-07-23T02:29:28.091ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 2 table_name = measurements_histogramu64
4602026-07-23T02:29:28.092ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 90 table_name = measurements_u64
4612026-07-23T02:29:28.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4622026-07-23T02:29:28.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4632026-07-23T02:29:28.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4642026-07-23T02:29:28.173ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
4652026-07-23T02:29:28.205ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
4662026-07-23T02:29:28.205ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/57167f76-7ab5-441b-9c48-8f6f6c594ad2/producers?sort_by=id_ascending
4672026-07-23T02:29:28.210ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/57167f76-7ab5-441b-9c48-8f6f6c594ad2/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "057bba58-e407-484f-8aad-dd94a38229f1", "content-length": "1133", "date": "Thu, 23 Jul 2026 02:29:28 GMT"} })
4682026-07-23T02:29:28.210ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/57167f76-7ab5-441b-9c48-8f6f6c594ad2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkMDEzMzc1MC1lN2I3LTQ1NTgtODFmNC03N2FlZTU5NzQyOTcifX0%3D
4692026-07-23T02:29:28.213ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/57167f76-7ab5-441b-9c48-8f6f6c594ad2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkMDEzMzc1MC1lN2I3LTQ1NTgtODFmNC03N2FlZTU5NzQyOTcifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "59c496be-0bf9-4837-b5e6-63b647bd6ea2", "content-length": "29", "date": "Thu, 23 Jul 2026 02:29:28 GMT"} })
4702026-07-23T02:29:28.213ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 7 n_pruned_tasks = 0
4712026-07-23T02:29:28.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4722026-07-23T02:29:28.550ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4732026-07-23T02:29:28.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4742026-07-23T02:29:29.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4752026-07-23T02:29:29.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4762026-07-23T02:29:29.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4772026-07-23T02:29:29.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4782026-07-23T02:29:29.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4792026-07-23T02:29:29.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4802026-07-23T02:29:29.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4812026-07-23T02:29:29.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4822026-07-23T02:29:29.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4832026-07-23T02:29:30.014ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4842026-07-23T02:29:30.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4852026-07-23T02:29:30.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4862026-07-23T02:29:30.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4872026-07-23T02:29:30.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4882026-07-23T02:29:30.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4892026-07-23T02:29:30.352ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 4486e5fb-a1cd-40af-9c40-c8bb59e9b9a6 producer_ip = fd00:1122:3344:101::a producer_port = 46309
4902026-07-23T02:29:30.352ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 4486e5fb-a1cd-40af-9c40-c8bb59e9b9a6 producer_ip = fd00:1122:3344:101::a producer_port = 46309
4912026-07-23T02:29:30.354ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 4486e5fb-a1cd-40af-9c40-c8bb59e9b9a6 producer_ip = fd00:1122:3344:101::a producer_port = 46309
4922026-07-23T02:29:30.548ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4932026-07-23T02:29:30.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4942026-07-23T02:29:30.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4952026-07-23T02:29:31.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4962026-07-23T02:29:31.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4972026-07-23T02:29:31.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4982026-07-23T02:29:31.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4992026-07-23T02:29:31.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5002026-07-23T02:29:31.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5012026-07-23T02:29:31.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5022026-07-23T02:29:31.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5032026-07-23T02:29:31.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5042026-07-23T02:29:32.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5052026-07-23T02:29:32.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5062026-07-23T02:29:32.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5072026-07-23T02:29:32.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5082026-07-23T02:29:32.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5092026-07-23T02:29:32.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5102026-07-23T02:29:32.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5112026-07-23T02:29:32.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5122026-07-23T02:29:32.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5132026-07-23T02:29:33.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5142026-07-23T02:29:33.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5152026-07-23T02:29:33.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5162026-07-23T02:29:33.032ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = aa18ee5f-63ba-4bde-b1dd-20db9b63b372 producer_ip = fd00:1122:3344:101::2 producer_port = 52550
5172026-07-23T02:29:33.032ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = aa18ee5f-63ba-4bde-b1dd-20db9b63b372 producer_ip = fd00:1122:3344:101::2 producer_port = 52550
5182026-07-23T02:29:33.033ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = aa18ee5f-63ba-4bde-b1dd-20db9b63b372 producer_ip = fd00:1122:3344:101::2 producer_port = 52550
5192026-07-23T02:29:33.071ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 258
5202026-07-23T02:29:33.071ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 258
5212026-07-23T02:29:33.071ZDEBGoximeter (clickhouse-client): unrolling 258 total samples collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
5222026-07-23T02:29:33.071ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
5232026-07-23T02:29:33.077ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 156 table_name = fields_string
5242026-07-23T02:29:33.078ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 38 table_name = fields_u16
5252026-07-23T02:29:33.079ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 126 table_name = fields_uuid
5262026-07-23T02:29:33.080ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 160 table_name = measurements_cumulativeu64
5272026-07-23T02:29:33.082ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 38 table_name = measurements_histogramu64
5282026-07-23T02:29:33.083ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 60 table_name = measurements_u64
5292026-07-23T02:29:33.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5302026-07-23T02:29:33.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5312026-07-23T02:29:33.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5322026-07-23T02:29:33.173ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
5332026-07-23T02:29:33.251ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = d0133750-e7b7-4558-81f4-77aee5974297 producer_ip = fd00:1122:3344:101::2 producer_port = 41495
5342026-07-23T02:29:33.251ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = d0133750-e7b7-4558-81f4-77aee5974297 producer_ip = fd00:1122:3344:101::2 producer_port = 41495
5352026-07-23T02:29:33.259ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = d0133750-e7b7-4558-81f4-77aee5974297 producer_ip = fd00:1122:3344:101::2 producer_port = 41495
5362026-07-23T02:29:33.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5372026-07-23T02:29:33.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5382026-07-23T02:29:33.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5392026-07-23T02:29:34.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5402026-07-23T02:29:34.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5412026-07-23T02:29:34.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5422026-07-23T02:29:34.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5432026-07-23T02:29:34.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5442026-07-23T02:29:34.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5452026-07-23T02:29:34.548ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5462026-07-23T02:29:34.548ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5472026-07-23T02:29:34.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5482026-07-23T02:29:34.723ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 5a587403-4922-4caf-9b07-c9826344fc11 producer_ip = fd00:1122:3344:101::b producer_port = 52274
5492026-07-23T02:29:34.723ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 5a587403-4922-4caf-9b07-c9826344fc11 producer_ip = fd00:1122:3344:101::b producer_port = 52274
5502026-07-23T02:29:34.723ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 5a587403-4922-4caf-9b07-c9826344fc11 producer_ip = fd00:1122:3344:101::b producer_port = 52274
5512026-07-23T02:29:35.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5522026-07-23T02:29:35.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5532026-07-23T02:29:35.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5542026-07-23T02:29:35.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5552026-07-23T02:29:35.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5562026-07-23T02:29:35.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5572026-07-23T02:29:35.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5582026-07-23T02:29:35.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5592026-07-23T02:29:35.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5602026-07-23T02:29:36.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5612026-07-23T02:29:36.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5622026-07-23T02:29:36.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5632026-07-23T02:29:36.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5642026-07-23T02:29:36.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5652026-07-23T02:29:36.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5662026-07-23T02:29:36.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5672026-07-23T02:29:36.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5682026-07-23T02:29:36.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5692026-07-23T02:29:37.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5702026-07-23T02:29:37.016ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5712026-07-23T02:29:37.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5722026-07-23T02:29:37.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5732026-07-23T02:29:37.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5742026-07-23T02:29:37.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5752026-07-23T02:29:37.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5762026-07-23T02:29:37.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5772026-07-23T02:29:37.551ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5782026-07-23T02:29:38.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5792026-07-23T02:29:38.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5802026-07-23T02:29:38.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5812026-07-23T02:29:38.071ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 362
5822026-07-23T02:29:38.071ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 362
5832026-07-23T02:29:38.071ZDEBGoximeter (clickhouse-client): unrolling 362 total samples collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
5842026-07-23T02:29:38.072ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
5852026-07-23T02:29:38.080ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 280 table_name = fields_i16
5862026-07-23T02:29:38.082ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 805 table_name = fields_string
5872026-07-23T02:29:38.083ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 142 table_name = fields_u16
5882026-07-23T02:29:38.085ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 145 table_name = fields_u32
5892026-07-23T02:29:38.086ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 144 table_name = fields_u8
5902026-07-23T02:29:38.087ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 510 table_name = fields_uuid
5912026-07-23T02:29:38.089ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 4 table_name = measurements_bool
5922026-07-23T02:29:38.090ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 265 table_name = measurements_cumulativeu64
5932026-07-23T02:29:38.091ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 1 table_name = measurements_f64
5942026-07-23T02:29:38.093ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 2 table_name = measurements_histogramu64
5952026-07-23T02:29:38.094ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 90 table_name = measurements_u64
5962026-07-23T02:29:38.108ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5972026-07-23T02:29:38.108ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5982026-07-23T02:29:38.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5992026-07-23T02:29:38.172ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
6002026-07-23T02:29:38.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6012026-07-23T02:29:38.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6022026-07-23T02:29:38.551ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6032026-07-23T02:29:39.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6042026-07-23T02:29:39.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6052026-07-23T02:29:39.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6062026-07-23T02:29:39.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6072026-07-23T02:29:39.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6082026-07-23T02:29:39.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6092026-07-23T02:29:39.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6102026-07-23T02:29:39.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6112026-07-23T02:29:39.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6122026-07-23T02:29:40.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6132026-07-23T02:29:40.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6142026-07-23T02:29:40.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6152026-07-23T02:29:40.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6162026-07-23T02:29:40.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6172026-07-23T02:29:40.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6182026-07-23T02:29:40.352ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 4486e5fb-a1cd-40af-9c40-c8bb59e9b9a6 producer_ip = fd00:1122:3344:101::a producer_port = 46309
6192026-07-23T02:29:40.352ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 4486e5fb-a1cd-40af-9c40-c8bb59e9b9a6 producer_ip = fd00:1122:3344:101::a producer_port = 46309
6202026-07-23T02:29:40.354ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 4486e5fb-a1cd-40af-9c40-c8bb59e9b9a6 producer_ip = fd00:1122:3344:101::a producer_port = 46309
6212026-07-23T02:29:40.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6222026-07-23T02:29:40.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6232026-07-23T02:29:40.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6242026-07-23T02:29:41.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6252026-07-23T02:29:41.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6262026-07-23T02:29:41.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6272026-07-23T02:29:41.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6282026-07-23T02:29:41.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6292026-07-23T02:29:41.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6302026-07-23T02:29:41.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6312026-07-23T02:29:41.550ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6322026-07-23T02:29:41.551ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6332026-07-23T02:29:42.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6342026-07-23T02:29:42.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6352026-07-23T02:29:42.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6362026-07-23T02:29:42.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6372026-07-23T02:29:42.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6382026-07-23T02:29:42.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6392026-07-23T02:29:42.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6402026-07-23T02:29:42.550ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6412026-07-23T02:29:42.551ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6422026-07-23T02:29:43.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6432026-07-23T02:29:43.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6442026-07-23T02:29:43.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6452026-07-23T02:29:43.032ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = aa18ee5f-63ba-4bde-b1dd-20db9b63b372 producer_ip = fd00:1122:3344:101::2 producer_port = 52550
6462026-07-23T02:29:43.032ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = aa18ee5f-63ba-4bde-b1dd-20db9b63b372 producer_ip = fd00:1122:3344:101::2 producer_port = 52550
6472026-07-23T02:29:43.033ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = aa18ee5f-63ba-4bde-b1dd-20db9b63b372 producer_ip = fd00:1122:3344:101::2 producer_port = 52550
6482026-07-23T02:29:43.071ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 258
6492026-07-23T02:29:43.071ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 258
6502026-07-23T02:29:43.071ZDEBGoximeter (clickhouse-client): unrolling 258 total samples collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
6512026-07-23T02:29:43.071ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
6522026-07-23T02:29:43.077ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 156 table_name = fields_string
6532026-07-23T02:29:43.079ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 38 table_name = fields_u16
6542026-07-23T02:29:43.080ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 126 table_name = fields_uuid
6552026-07-23T02:29:43.082ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 160 table_name = measurements_cumulativeu64
6562026-07-23T02:29:43.084ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 38 table_name = measurements_histogramu64
6572026-07-23T02:29:43.086ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 60 table_name = measurements_u64
6582026-07-23T02:29:43.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6592026-07-23T02:29:43.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6602026-07-23T02:29:43.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6612026-07-23T02:29:43.172ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
6622026-07-23T02:29:43.205ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
6632026-07-23T02:29:43.205ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/57167f76-7ab5-441b-9c48-8f6f6c594ad2/producers?sort_by=id_ascending
6642026-07-23T02:29:43.208ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/57167f76-7ab5-441b-9c48-8f6f6c594ad2/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6d8cc26-88a7-458e-af79-f8cabbd19095", "content-length": "1412", "date": "Thu, 23 Jul 2026 02:29:43 GMT"} })
6652026-07-23T02:29:43.208ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/57167f76-7ab5-441b-9c48-8f6f6c594ad2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmRmYTk2Mi0wMDU0LTRlZGEtOWY2NS05ZjY3MjBiODRhODYifX0%3D
6662026-07-23T02:29:43.211ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/57167f76-7ab5-441b-9c48-8f6f6c594ad2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmRmYTk2Mi0wMDU0LTRlZGEtOWY2NS05ZjY3MjBiODRhODYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5dd65af-6c73-4937-90d0-00d7daeda3e6", "content-length": "29", "date": "Thu, 23 Jul 2026 02:29:43 GMT"} })
6672026-07-23T02:29:43.211ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:46768 collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 68c3d9c7-793a-4679-b688-dd907f89e6f6
6682026-07-23T02:29:43.211ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:45796 collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = ebdfa962-0054-4eda-9f65-9f6720b84a86
6692026-07-23T02:29:43.211ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 9 n_pruned_tasks = 0
6702026-07-23T02:29:43.251ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = d0133750-e7b7-4558-81f4-77aee5974297 producer_ip = fd00:1122:3344:101::2 producer_port = 41495
6712026-07-23T02:29:43.251ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = d0133750-e7b7-4558-81f4-77aee5974297 producer_ip = fd00:1122:3344:101::2 producer_port = 41495
6722026-07-23T02:29:43.258ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = d0133750-e7b7-4558-81f4-77aee5974297 producer_ip = fd00:1122:3344:101::2 producer_port = 41495
6732026-07-23T02:29:43.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6742026-07-23T02:29:43.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6752026-07-23T02:29:43.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6762026-07-23T02:29:44.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6772026-07-23T02:29:44.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6782026-07-23T02:29:44.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6792026-07-23T02:29:44.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6802026-07-23T02:29:44.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6812026-07-23T02:29:44.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6822026-07-23T02:29:44.200ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 5a587403-4922-4caf-9b07-c9826344fc11 producer_ip = fd00:1122:3344:101::b producer_port = 52274
6832026-07-23T02:29:44.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6842026-07-23T02:29:44.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6852026-07-23T02:29:44.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6862026-07-23T02:29:44.723ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 5a587403-4922-4caf-9b07-c9826344fc11 producer_ip = fd00:1122:3344:101::b producer_port = 52274
6872026-07-23T02:29:44.723ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 5a587403-4922-4caf-9b07-c9826344fc11 producer_ip = fd00:1122:3344:101::b producer_port = 52274
6882026-07-23T02:29:44.724ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 5a587403-4922-4caf-9b07-c9826344fc11 producer_ip = fd00:1122:3344:101::b producer_port = 52274
6892026-07-23T02:29:45.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6902026-07-23T02:29:45.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6912026-07-23T02:29:45.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6922026-07-23T02:29:45.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6932026-07-23T02:29:45.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6942026-07-23T02:29:45.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6952026-07-23T02:29:45.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6962026-07-23T02:29:45.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6972026-07-23T02:29:45.551ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6982026-07-23T02:29:45.562ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = ebdfa962-0054-4eda-9f65-9f6720b84a86 producer_ip = fd00:1122:3344:101::c producer_port = 45796
6992026-07-23T02:29:45.562ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = ebdfa962-0054-4eda-9f65-9f6720b84a86 producer_ip = fd00:1122:3344:101::c producer_port = 45796
7002026-07-23T02:29:45.570ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 10 producer_id = ebdfa962-0054-4eda-9f65-9f6720b84a86 producer_ip = fd00:1122:3344:101::c producer_port = 45796
7012026-07-23T02:29:46.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7022026-07-23T02:29:46.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7032026-07-23T02:29:46.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7042026-07-23T02:29:46.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7052026-07-23T02:29:46.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7062026-07-23T02:29:46.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7072026-07-23T02:29:46.550ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7082026-07-23T02:29:46.550ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7092026-07-23T02:29:46.551ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7102026-07-23T02:29:47.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7112026-07-23T02:29:47.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7122026-07-23T02:29:47.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7132026-07-23T02:29:47.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7142026-07-23T02:29:47.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7152026-07-23T02:29:47.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7162026-07-23T02:29:47.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7172026-07-23T02:29:47.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7182026-07-23T02:29:47.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7192026-07-23T02:29:48.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7202026-07-23T02:29:48.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7212026-07-23T02:29:48.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7222026-07-23T02:29:48.071ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 378
7232026-07-23T02:29:48.071ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 378
7242026-07-23T02:29:48.071ZDEBGoximeter (clickhouse-client): unrolling 378 total samples collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
7252026-07-23T02:29:48.072ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
7262026-07-23T02:29:48.080ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 280 table_name = fields_i16
7272026-07-23T02:29:48.081ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 8 table_name = fields_ipaddr
7282026-07-23T02:29:48.083ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 813 table_name = fields_string
7292026-07-23T02:29:48.085ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 151 table_name = fields_u16
7302026-07-23T02:29:48.086ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 145 table_name = fields_u32
7312026-07-23T02:29:48.087ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 144 table_name = fields_u8
7322026-07-23T02:29:48.089ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 528 table_name = fields_uuid
7332026-07-23T02:29:48.090ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 4 table_name = measurements_bool
7342026-07-23T02:29:48.091ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 269 table_name = measurements_cumulativeu64
7352026-07-23T02:29:48.092ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 1 table_name = measurements_f64
7362026-07-23T02:29:48.095ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 5 table_name = measurements_histogramu64
7372026-07-23T02:29:48.096ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 9 table_name = measurements_i64
7382026-07-23T02:29:48.097ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 90 table_name = measurements_u64
7392026-07-23T02:29:48.108ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7402026-07-23T02:29:48.108ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7412026-07-23T02:29:48.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7422026-07-23T02:29:48.172ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
7432026-07-23T02:29:48.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7442026-07-23T02:29:48.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7452026-07-23T02:29:48.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7462026-07-23T02:29:49.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7472026-07-23T02:29:49.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7482026-07-23T02:29:49.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7492026-07-23T02:29:49.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7502026-07-23T02:29:49.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7512026-07-23T02:29:49.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7522026-07-23T02:29:49.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7532026-07-23T02:29:49.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7542026-07-23T02:29:49.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7552026-07-23T02:29:50.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7562026-07-23T02:29:50.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7572026-07-23T02:29:50.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7582026-07-23T02:29:50.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7592026-07-23T02:29:50.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7602026-07-23T02:29:50.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7612026-07-23T02:29:50.310ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = aa18ee5f-63ba-4bde-b1dd-20db9b63b372 producer_ip = fd00:1122:3344:101::2 producer_port = 52550
7622026-07-23T02:29:50.352ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 4486e5fb-a1cd-40af-9c40-c8bb59e9b9a6 producer_ip = fd00:1122:3344:101::a producer_port = 46309
7632026-07-23T02:29:50.352ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 4486e5fb-a1cd-40af-9c40-c8bb59e9b9a6 producer_ip = fd00:1122:3344:101::a producer_port = 46309
7642026-07-23T02:29:50.354ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 4486e5fb-a1cd-40af-9c40-c8bb59e9b9a6 producer_ip = fd00:1122:3344:101::a producer_port = 46309
7652026-07-23T02:29:50.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7662026-07-23T02:29:50.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7672026-07-23T02:29:50.551ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7682026-07-23T02:29:51.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7692026-07-23T02:29:51.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7702026-07-23T02:29:51.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7712026-07-23T02:29:51.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7722026-07-23T02:29:51.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7732026-07-23T02:29:51.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7742026-07-23T02:29:51.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7752026-07-23T02:29:51.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7762026-07-23T02:29:51.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7772026-07-23T02:29:52.016ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7782026-07-23T02:29:52.016ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7792026-07-23T02:29:52.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7802026-07-23T02:29:52.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7812026-07-23T02:29:52.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7822026-07-23T02:29:52.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7832026-07-23T02:29:52.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7842026-07-23T02:29:52.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7852026-07-23T02:29:52.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7862026-07-23T02:29:53.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7872026-07-23T02:29:53.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7882026-07-23T02:29:53.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7892026-07-23T02:29:53.032ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = aa18ee5f-63ba-4bde-b1dd-20db9b63b372 producer_ip = fd00:1122:3344:101::2 producer_port = 52550
7902026-07-23T02:29:53.032ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = aa18ee5f-63ba-4bde-b1dd-20db9b63b372 producer_ip = fd00:1122:3344:101::2 producer_port = 52550
7912026-07-23T02:29:53.033ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = aa18ee5f-63ba-4bde-b1dd-20db9b63b372 producer_ip = fd00:1122:3344:101::2 producer_port = 52550
7922026-07-23T02:29:53.071ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 260
7932026-07-23T02:29:53.071ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 260
7942026-07-23T02:29:53.071ZDEBGoximeter (clickhouse-client): unrolling 260 total samples collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
7952026-07-23T02:29:53.071ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
7962026-07-23T02:29:53.078ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 4 table_name = fields_ipaddr
7972026-07-23T02:29:53.079ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 158 table_name = fields_string
7982026-07-23T02:29:53.080ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 42 table_name = fields_u16
7992026-07-23T02:29:53.081ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 130 table_name = fields_uuid
8002026-07-23T02:29:53.082ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 162 table_name = measurements_cumulativeu64
8012026-07-23T02:29:53.084ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 38 table_name = measurements_histogramu64
8022026-07-23T02:29:53.086ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 60 table_name = measurements_u64
8032026-07-23T02:29:53.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8042026-07-23T02:29:53.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8052026-07-23T02:29:53.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8062026-07-23T02:29:53.172ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
8072026-07-23T02:29:53.251ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = d0133750-e7b7-4558-81f4-77aee5974297 producer_ip = fd00:1122:3344:101::2 producer_port = 41495
8082026-07-23T02:29:53.251ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = d0133750-e7b7-4558-81f4-77aee5974297 producer_ip = fd00:1122:3344:101::2 producer_port = 41495
8092026-07-23T02:29:53.257ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = d0133750-e7b7-4558-81f4-77aee5974297 producer_ip = fd00:1122:3344:101::2 producer_port = 41495
8102026-07-23T02:29:53.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8112026-07-23T02:29:53.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8122026-07-23T02:29:53.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8132026-07-23T02:29:54.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8142026-07-23T02:29:54.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8152026-07-23T02:29:54.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8162026-07-23T02:29:54.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8172026-07-23T02:29:54.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8182026-07-23T02:29:54.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8192026-07-23T02:29:54.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8202026-07-23T02:29:54.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8212026-07-23T02:29:54.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8222026-07-23T02:29:54.723ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 5a587403-4922-4caf-9b07-c9826344fc11 producer_ip = fd00:1122:3344:101::b producer_port = 52274
8232026-07-23T02:29:54.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 5a587403-4922-4caf-9b07-c9826344fc11 producer_ip = fd00:1122:3344:101::b producer_port = 52274
8242026-07-23T02:29:54.724ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 5a587403-4922-4caf-9b07-c9826344fc11 producer_ip = fd00:1122:3344:101::b producer_port = 52274
8252026-07-23T02:29:54.912ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 68c3d9c7-793a-4679-b688-dd907f89e6f6 producer_ip = fd00:1122:3344:101::1 producer_port = 46768
8262026-07-23T02:29:54.912ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 68c3d9c7-793a-4679-b688-dd907f89e6f6 producer_ip = fd00:1122:3344:101::1 producer_port = 46768
8272026-07-23T02:29:55.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8282026-07-23T02:29:55.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8292026-07-23T02:29:55.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8302026-07-23T02:29:55.043ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 7271 producer_id = 68c3d9c7-793a-4679-b688-dd907f89e6f6 producer_ip = fd00:1122:3344:101::1 producer_port = 46768
8312026-07-23T02:29:55.084ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 7501
8322026-07-23T02:29:55.085ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 7501
8332026-07-23T02:29:55.085ZDEBGoximeter (clickhouse-client): unrolling 7501 total samples collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
8342026-07-23T02:29:55.086ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
8352026-07-23T02:29:55.089ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_cpu:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "cpu_id", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:55.085461368Z } timeseries_name = sled_cpu:cpu_nsec
8362026-07-23T02:29:55.089ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:55.085438318Z } timeseries_name = sled_data_link:bytes_received
8372026-07-23T02:29:55.089ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:55.085441838Z } timeseries_name = sled_data_link:bytes_sent
8382026-07-23T02:29:55.089ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:55.085434488Z } timeseries_name = sled_data_link:errors_received
8392026-07-23T02:29:55.089ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:55.085436408Z } timeseries_name = sled_data_link:errors_sent
8402026-07-23T02:29:55.089ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:55.085440068Z } timeseries_name = sled_data_link:packets_received
8412026-07-23T02:29:55.089ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:55.085444008Z } timeseries_name = sled_data_link:packets_sent
8422026-07-23T02:29:55.089ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_dataset:bytes_used"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "dataset_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "dataset_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "dataset_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:55.086560551Z } timeseries_name = zfs_dataset:bytes_used
8432026-07-23T02:29:55.089ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_pool:bytes_allocated"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:55.086551321Z } timeseries_name = zfs_pool:bytes_allocated
8442026-07-23T02:29:55.089ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_pool:bytes_total"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:55.086553921Z } timeseries_name = zfs_pool:bytes_total
8452026-07-23T02:29:55.089ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zone:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_type", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T02:29:55.085881133Z } timeseries_name = zone:cpu_nsec
8462026-07-23T02:29:55.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8472026-07-23T02:29:55.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8482026-07-23T02:29:55.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8492026-07-23T02:29:55.122ZDEBGoximeter (clickhouse-client): inserting 11 new timeseries schema collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
8502026-07-23T02:29:55.125ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 280 table_name = fields_i16
8512026-07-23T02:29:55.129ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 4012 table_name = fields_string
8522026-07-23T02:29:55.130ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 153 table_name = fields_u16
8532026-07-23T02:29:55.131ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 1098 table_name = fields_u32
8542026-07-23T02:29:55.133ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 144 table_name = fields_u8
8552026-07-23T02:29:55.135ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 2318 table_name = fields_uuid
8562026-07-23T02:29:55.136ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 4 table_name = measurements_bool
8572026-07-23T02:29:55.139ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 6973 table_name = measurements_cumulativeu64
8582026-07-23T02:29:55.140ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 1 table_name = measurements_f64
8592026-07-23T02:29:55.142ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 13 table_name = measurements_histogramu64
8602026-07-23T02:29:55.143ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 510 table_name = measurements_u64
8612026-07-23T02:29:55.185ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
8622026-07-23T02:29:55.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8632026-07-23T02:29:55.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8642026-07-23T02:29:55.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8652026-07-23T02:29:55.562ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = ebdfa962-0054-4eda-9f65-9f6720b84a86 producer_ip = fd00:1122:3344:101::c producer_port = 45796
8662026-07-23T02:29:55.563ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = ebdfa962-0054-4eda-9f65-9f6720b84a86 producer_ip = fd00:1122:3344:101::c producer_port = 45796
8672026-07-23T02:29:55.563ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 1 producer_id = ebdfa962-0054-4eda-9f65-9f6720b84a86 producer_ip = fd00:1122:3344:101::c producer_port = 45796
8682026-07-23T02:29:56.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8692026-07-23T02:29:56.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8702026-07-23T02:29:56.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8712026-07-23T02:29:56.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8722026-07-23T02:29:56.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8732026-07-23T02:29:56.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8742026-07-23T02:29:56.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8752026-07-23T02:29:56.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8762026-07-23T02:29:56.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8772026-07-23T02:29:57.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8782026-07-23T02:29:57.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8792026-07-23T02:29:57.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8802026-07-23T02:29:57.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8812026-07-23T02:29:57.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8822026-07-23T02:29:57.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8832026-07-23T02:29:57.249ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8842026-07-23T02:29:57.550ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8852026-07-23T02:29:57.550ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8862026-07-23T02:29:57.551ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8872026-07-23T02:29:58.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8882026-07-23T02:29:58.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8892026-07-23T02:29:58.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8902026-07-23T02:29:58.071ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 135
8912026-07-23T02:29:58.071ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_samples = 135
8922026-07-23T02:29:58.071ZDEBGoximeter (clickhouse-client): unrolling 135 total samples collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
8932026-07-23T02:29:58.071ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1
8942026-07-23T02:29:58.075ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 4 table_name = fields_ipaddr
8952026-07-23T02:29:58.077ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 84 table_name = fields_string
8962026-07-23T02:29:58.078ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 5 table_name = fields_u16
8972026-07-23T02:29:58.079ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 93 table_name = fields_uuid
8982026-07-23T02:29:58.080ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 98 table_name = measurements_cumulativeu64
8992026-07-23T02:29:58.082ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 1 table_name = measurements_histogramu64
9002026-07-23T02:29:58.083ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d id = 0b74ed19-6a63-4f98-801c-f77c00ecf9c1 n_rows = 36 table_name = measurements_u64
9012026-07-23T02:29:58.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9022026-07-23T02:29:58.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9032026-07-23T02:29:58.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9042026-07-23T02:29:58.172ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
9052026-07-23T02:29:58.205ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
9062026-07-23T02:29:58.205ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/57167f76-7ab5-441b-9c48-8f6f6c594ad2/producers?sort_by=id_ascending
9072026-07-23T02:29:58.211ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/57167f76-7ab5-441b-9c48-8f6f6c594ad2/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d50652d-47e2-482f-9073-bad4614ac462", "content-length": "1412", "date": "Thu, 23 Jul 2026 02:29:58 GMT"} })
9082026-07-23T02:29:58.211ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/57167f76-7ab5-441b-9c48-8f6f6c594ad2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmRmYTk2Mi0wMDU0LTRlZGEtOWY2NS05ZjY3MjBiODRhODYifX0%3D
9092026-07-23T02:29:58.214ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/57167f76-7ab5-441b-9c48-8f6f6c594ad2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmRmYTk2Mi0wMDU0LTRlZGEtOWY2NS05ZjY3MjBiODRhODYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd073733-1906-451e-bf5c-24ca9811583f", "content-length": "29", "date": "Thu, 23 Jul 2026 02:29:58 GMT"} })
9102026-07-23T02:29:58.214ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 9 n_pruned_tasks = 0
9112026-07-23T02:29:58.274ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9122026-07-23T02:29:58.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9132026-07-23T02:29:58.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9142026-07-23T02:29:58.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9152026-07-23T02:29:59.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9162026-07-23T02:29:59.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9172026-07-23T02:29:59.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9182026-07-23T02:29:59.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9192026-07-23T02:29:59.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9202026-07-23T02:29:59.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9212026-07-23T02:29:59.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9222026-07-23T02:29:59.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9232026-07-23T02:29:59.551ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9242026-07-23T02:30:00.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9252026-07-23T02:30:00.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9262026-07-23T02:30:00.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9272026-07-23T02:30:00.108ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9282026-07-23T02:30:00.108ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9292026-07-23T02:30:00.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9302026-07-23T02:30:00.353ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 4486e5fb-a1cd-40af-9c40-c8bb59e9b9a6 producer_ip = fd00:1122:3344:101::a producer_port = 46309
9312026-07-23T02:30:00.353ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 4486e5fb-a1cd-40af-9c40-c8bb59e9b9a6 producer_ip = fd00:1122:3344:101::a producer_port = 46309
9322026-07-23T02:30:00.355ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 27 producer_id = 4486e5fb-a1cd-40af-9c40-c8bb59e9b9a6 producer_ip = fd00:1122:3344:101::a producer_port = 46309
9332026-07-23T02:30:00.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9342026-07-23T02:30:00.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9352026-07-23T02:30:00.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9362026-07-23T02:30:01.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9372026-07-23T02:30:01.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9382026-07-23T02:30:01.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9392026-07-23T02:30:01.107ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9402026-07-23T02:30:01.107ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9412026-07-23T02:30:01.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9422026-07-23T02:30:01.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9432026-07-23T02:30:01.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9442026-07-23T02:30:01.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9452026-07-23T02:30:01.892ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 68c3d9c7-793a-4679-b688-dd907f89e6f6 producer_ip = fd00:1122:3344:101::1 producer_port = 46768
9462026-07-23T02:30:02.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9472026-07-23T02:30:02.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9482026-07-23T02:30:02.016ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9492026-07-23T02:30:02.108ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9502026-07-23T02:30:02.108ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9512026-07-23T02:30:02.109ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 1b9e039c-08c2-4828-9d77-db69254d4b56 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9522026-07-23T02:30:02.549ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9532026-07-23T02:30:02.549ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9542026-07-23T02:30:02.550ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 2bdf34f4-611d-4a90-90df-774fa5277395 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9552026-07-23T02:30:03.015ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9562026-07-23T02:30:03.015ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9572026-07-23T02:30:03.017ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2b47f93-ce85-4287-b477-577a6a3d9148 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9582026-07-23T02:30:03.032ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = aa18ee5f-63ba-4bde-b1dd-20db9b63b372 producer_ip = fd00:1122:3344:101::2 producer_port = 52550
9592026-07-23T02:30:03.032ZDEBGoximeter (collection-task): collecting from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d producer_id = aa18ee5f-63ba-4bde-b1dd-20db9b63b372 producer_ip = fd00:1122:3344:101::2 producer_port = 52550
9602026-07-23T02:30:03.033ZDEBGoximeter (collection-task): collected results from producer collector_id = 57167f76-7ab5-441b-9c48-8f6f6c594ad2 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = aa18ee5f-63ba-4bde-b1dd-20db9b63b372 producer_ip = fd00:1122:3344:101::2 producer_port = 52550