Max level shown:
1 [ Oct 30 17:58:56 Enabled. ]
2 [ Oct 30 17:58:56 Rereading configuration. ]
3 [ Oct 30 17:58:57 Rereading configuration. ]
4 [ Oct 30 17:59:01 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id a24d1464-46d3-4d98-b287-671ce5086a07 &"). ]
5 [ Oct 30 17:59:01 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-10-30T17:59:01.118ZDEBGoximeter: registered DTrace probes
82026-10-30T17:59:01.118ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:291
92026-10-30T17:59:01.119ZDEBGoximeter: creating ClickHouse client
102026-10-30T17:59:01.127ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 70014043-432f-4c49-a9c3-ba05f70d36a7
112026-10-30T17:59:03.854ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:876 id = 70014043-432f-4c49-a9c3-ba05f70d36a7
122026-10-30T17:59:03.854ZWARNoximeter (oximeter-agent): oximeter database is not present or not at the expected version collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d error = Database is not at expected version file = oximeter/collector/src/agent.rs:114
132026-10-30T17:59:03.855ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseVersionMismatch { expected: 14, found: 0 }) file = oximeter/collector/src/lib.rs:343 retry_after = 365.911308ms
142026-10-30T17:59:04.222ZDEBGoximeter: creating ClickHouse client
152026-10-30T17:59:04.222ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 0dab601c-b05b-462c-8116-386815d00054
162026-10-30T17:59:04.227ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:876 id = 0dab601c-b05b-462c-8116-386815d00054
172026-10-30T17:59:04.227ZWARNoximeter (oximeter-agent): oximeter database is not present or not at the expected version collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d error = Database is not at expected version file = oximeter/collector/src/agent.rs:114
182026-10-30T17:59:04.227ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseVersionMismatch { expected: 14, found: 0 }) file = oximeter/collector/src/lib.rs:343 retry_after = 547.048194ms
192026-10-30T17:59:04.774ZDEBGoximeter: creating ClickHouse client
202026-10-30T17:59:04.774ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = f6cf4052-8b23-463c-8633-96f3877b0344
212026-10-30T17:59:04.778ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:876 id = f6cf4052-8b23-463c-8633-96f3877b0344
222026-10-30T17:59:04.778ZWARNoximeter (oximeter-agent): oximeter database is not present or not at the expected version collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d error = Database is not at expected version file = oximeter/collector/src/agent.rs:114
232026-10-30T17:59:04.778ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseVersionMismatch { expected: 14, found: 0 }) file = oximeter/collector/src/lib.rs:343 retry_after = 838.705713ms
242026-10-30T17:59:05.617ZDEBGoximeter: creating ClickHouse client
252026-10-30T17:59:05.617ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 18dca918-2c83-47d6-9fcb-1732718b21ec
262026-10-30T17:59:05.621ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:876 id = 18dca918-2c83-47d6-9fcb-1732718b21ec
272026-10-30T17:59:05.621ZWARNoximeter (oximeter-agent): oximeter database is not present or not at the expected version collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d error = Database is not at expected version file = oximeter/collector/src/agent.rs:114
282026-10-30T17:59:05.621ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseVersionMismatch { expected: 14, found: 0 }) file = oximeter/collector/src/lib.rs:343 retry_after = 2.386813125s
292026-10-30T17:59:08.008ZDEBGoximeter: creating ClickHouse client
302026-10-30T17:59:08.008ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = d284e5e0-db22-4bab-8ade-3758a6eb2b13
312026-10-30T17:59:08.013ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:876 id = d284e5e0-db22-4bab-8ade-3758a6eb2b13
322026-10-30T17:59:08.013ZWARNoximeter (oximeter-agent): oximeter database is not present or not at the expected version collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d error = Database is not at expected version file = oximeter/collector/src/agent.rs:114
332026-10-30T17:59:08.013ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseVersionMismatch { expected: 14, found: 0 }) file = oximeter/collector/src/lib.rs:343 retry_after = 4.199701857s
342026-10-30T17:59:12.213ZDEBGoximeter: creating ClickHouse client
352026-10-30T17:59:12.213ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = bc5fe277-567c-442e-b13e-46d7ba673e04
362026-10-30T17:59:12.218ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:876 id = bc5fe277-567c-442e-b13e-46d7ba673e04
372026-10-30T17:59:12.218ZWARNoximeter (oximeter-agent): oximeter database is not present or not at the expected version collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d error = Database is not at expected version file = oximeter/collector/src/agent.rs:114
382026-10-30T17:59:12.218ZWARNoximeter: failed to create ClickHouse client error = Database(DatabaseVersionMismatch { expected: 14, found: 0 }) file = oximeter/collector/src/lib.rs:343 retry_after = 7.203966139s
392026-10-30T17:59:19.423ZDEBGoximeter: creating ClickHouse client
402026-10-30T17:59:19.423ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae
412026-10-30T17:59:19.470ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = a201a699-56ce-497d-997c-7921324110c0
422026-10-30T17:59:19.485ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
432026-10-30T17:59:19.485ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
442026-10-30T17:59:19.485ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
452026-10-30T17:59:19.485ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
462026-10-30T17:59:19.485ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:335 local_addr = [fd00:1122:3344:101::d]:12223
472026-10-30T17:59:19.487ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
482026-10-30T17:59:19.487ZDEBGoximeter: registered USDT probes
492026-10-30T17:59:19.487ZDEBGoximeter: contacting nexus
502026-10-30T17:59:19.503ZDEBGoximeter: client request body = Some(Body) method = POST operation_id = cpapi_collectors_post uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
512026-10-30T17:59:19.519ZDEBGoximeter: client response operation_id = cpapi_collectors_post result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "6227dca4-d0a6-4422-917c-6b3f31c1d054", "date": "Fri, 30 Oct 2026 17:59:19 GMT"} })
522026-10-30T17:59:19.519ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:422 id = a24d1464-46d3-4d98-b287-671ce5086a07
532026-10-30T17:59:19.519ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:623
542026-10-30T17:59:19.520ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:626
552026-10-30T17:59:19.524ZDEBGoximeter: client request body = None method = GET operation_id = cpapi_assigned_producers_list uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a24d1464-46d3-4d98-b287-671ce5086a07/producers?sort_by=id_ascending
562026-10-30T17:59:19.536ZDEBGoximeter: client response operation_id = cpapi_assigned_producers_list result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a24d1464-46d3-4d98-b287-671ce5086a07/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "993b40ec-9cce-4ec6-9be2-f787d388e2ef", "content-length": "29", "date": "Fri, 30 Oct 2026 17:59:19 GMT"} })
572026-10-30T17:59:19.536ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:701 n_current_tasks = 0 n_pruned_tasks = 0
582026-10-30T17:59:24.471ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d n_samples = 4
592026-10-30T17:59:24.471ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d n_samples = 4
602026-10-30T17:59:24.473ZDEBGoximeter (clickhouse-client): unrolling 4 total samples collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae
612026-10-30T17:59:24.473ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae
622026-10-30T17:59:24.486ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:database_queue_depth"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "collector_sink", field_type: String, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:24.473878256Z } timeseries_name = oximeter_collector:database_queue_depth
632026-10-30T17:59:24.486ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:database_samples_dropped"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "collector_sink", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:24.473867226Z } timeseries_name = oximeter_collector:database_samples_dropped
642026-10-30T17:59:24.486ZDEBGoximeter (clickhouse-client): inserting 2 new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae
652026-10-30T17:59:24.498ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 4 table_name = fields_ipaddr
662026-10-30T17:59:24.500ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 4 table_name = fields_string
672026-10-30T17:59:24.502ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 4 table_name = fields_u16
682026-10-30T17:59:24.503ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 4 table_name = fields_uuid
692026-10-30T17:59:24.505ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 2 table_name = measurements_cumulativeu64
702026-10-30T17:59:24.511ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 2 table_name = measurements_histogramu64
712026-10-30T17:59:24.572ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
722026-10-30T17:59:29.472ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d
732026-10-30T17:59:29.472ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d
742026-10-30T17:59:34.472ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d
752026-10-30T17:59:34.472ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d
762026-10-30T17:59:34.519ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:626
772026-10-30T17:59:34.519ZDEBGoximeter: client request body = None method = GET operation_id = cpapi_assigned_producers_list uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/a24d1464-46d3-4d98-b287-671ce5086a07/producers?sort_by=id_ascending
782026-10-30T17:59:34.546ZDEBGoximeter: client response operation_id = cpapi_assigned_producers_list result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/a24d1464-46d3-4d98-b287-671ce5086a07/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e7f57e5-113c-45f4-a608-10e3e3d20b96", "content-length": "728", "date": "Fri, 30 Oct 2026 17:59:34 GMT"} })
792026-10-30T17:59:34.546ZDEBGoximeter: client request body = None method = GET operation_id = cpapi_assigned_producers_list uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/a24d1464-46d3-4d98-b287-671ce5086a07/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZjFiYjRiNy04YTI1LTQxMjUtYTcyYS02NjgzNGRkZjE0NDgifX0%3D
802026-10-30T17:59:34.550ZDEBGoximeter: client response operation_id = cpapi_assigned_producers_list result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/a24d1464-46d3-4d98-b287-671ce5086a07/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZjFiYjRiNy04YTI1LTQxMjUtYTcyYS02NjgzNGRkZjE0NDgifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "583efb1f-e8fb-4029-8964-331d70afb080", "content-length": "29", "date": "Fri, 30 Oct 2026 17:59:34 GMT"} })
812026-10-30T17:59:34.550ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:59935 collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = 1abd7ef2-712a-4900-bf45-ff2ada90a7e8
822026-10-30T17:59:34.550ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:47275 collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = 35e9b228-bf62-40ed-b89a-20c8f91dcedb
832026-10-30T17:59:34.550ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:40578 collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = 44a910ca-1269-4d56-ac16-e730789a9827
842026-10-30T17:59:34.550ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:62022 collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = cf1bb4b7-8a25-4125-a72a-66834ddf1448
852026-10-30T17:59:34.551ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:701 n_current_tasks = 4 n_pruned_tasks = 0
862026-10-30T17:59:34.830ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = cf1bb4b7-8a25-4125-a72a-66834ddf1448 producer_ip = fd00:1122:3344:101::2 producer_port = 62022
872026-10-30T17:59:35.118ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = 1abd7ef2-712a-4900-bf45-ff2ada90a7e8 producer_ip = fd00:1122:3344:101::b producer_port = 59935
882026-10-30T17:59:35.118ZDEBGoximeter (collection-task): collecting from producer collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = 1abd7ef2-712a-4900-bf45-ff2ada90a7e8 producer_ip = fd00:1122:3344:101::b producer_port = 59935
892026-10-30T17:59:35.126ZDEBGoximeter (collection-task): collected results from producer collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d n_results = 6 n_samples = 42 producer_id = 1abd7ef2-712a-4900-bf45-ff2ada90a7e8 producer_ip = fd00:1122:3344:101::b producer_port = 59935
902026-10-30T17:59:35.282ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = cf1bb4b7-8a25-4125-a72a-66834ddf1448 producer_ip = fd00:1122:3344:101::2 producer_port = 62022
912026-10-30T17:59:35.282ZDEBGoximeter (collection-task): collecting from producer collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = cf1bb4b7-8a25-4125-a72a-66834ddf1448 producer_ip = fd00:1122:3344:101::2 producer_port = 62022
922026-10-30T17:59:36.033ZDEBGoximeter (collection-task): collected results from producer collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 12804 producer_id = cf1bb4b7-8a25-4125-a72a-66834ddf1448 producer_ip = fd00:1122:3344:101::2 producer_port = 62022
932026-10-30T17:59:36.117ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d n_samples = 12848
942026-10-30T17:59:36.118ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d n_samples = 12848
952026-10-30T17:59:36.118ZDEBGoximeter (clickhouse-client): unrolling 12848 total samples collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae
962026-10-30T17:59:36.120ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae
972026-10-30T17:59:36.123ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:36.118421864Z } timeseries_name = collection_target:cpus_provisioned
982026-10-30T17:59:36.123ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:36.118422924Z } timeseries_name = collection_target:ram_provisioned
992026-10-30T17:59:36.123ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:36.118423954Z } timeseries_name = collection_target:virtual_disk_space_provisioned
1002026-10-30T17:59:36.123ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("hardware_component:current"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "chassis_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "chassis_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "description", field_type: String, source: Target, description: "" }, FieldSchema { name: "gateway_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "hubris_archive_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sensor", field_type: String, source: Metric, description: "" }, FieldSchema { name: "slot", field_type: U32, source: Target, description: "" }}, datum_type: F32, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:36.118453665Z } timeseries_name = hardware_component:current
1012026-10-30T17:59:36.124ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("hardware_component:fan_speed"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "chassis_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "chassis_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "description", field_type: String, source: Target, description: "" }, FieldSchema { name: "gateway_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "hubris_archive_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sensor", field_type: String, source: Metric, description: "" }, FieldSchema { name: "slot", field_type: U32, source: Target, description: "" }}, datum_type: F32, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:36.118479395Z } timeseries_name = hardware_component:fan_speed
1022026-10-30T17:59:36.124ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("hardware_component:input_current"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "chassis_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "chassis_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "description", field_type: String, source: Target, description: "" }, FieldSchema { name: "gateway_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "hubris_archive_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sensor", field_type: String, source: Metric, description: "" }, FieldSchema { name: "slot", field_type: U32, source: Target, description: "" }}, datum_type: F32, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:36.118467745Z } timeseries_name = hardware_component:input_current
1032026-10-30T17:59:36.124ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("hardware_component:input_voltage"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "chassis_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "chassis_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "description", field_type: String, source: Target, description: "" }, FieldSchema { name: "gateway_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "hubris_archive_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sensor", field_type: String, source: Metric, description: "" }, FieldSchema { name: "slot", field_type: U32, source: Target, description: "" }}, datum_type: F32, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:36.118471675Z } timeseries_name = hardware_component:input_voltage
1042026-10-30T17:59:36.124ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("hardware_component:temperature"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "chassis_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "chassis_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "description", field_type: String, source: Target, description: "" }, FieldSchema { name: "gateway_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "hubris_archive_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sensor", field_type: String, source: Metric, description: "" }, FieldSchema { name: "slot", field_type: U32, source: Target, description: "" }}, datum_type: F32, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:36.118441474Z } timeseries_name = hardware_component:temperature
1052026-10-30T17:59:36.124ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("hardware_component:voltage"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "chassis_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "chassis_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "chassis_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "component_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "description", field_type: String, source: Target, description: "" }, FieldSchema { name: "gateway_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "hubris_archive_id", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sensor", field_type: String, source: Metric, description: "" }, FieldSchema { name: "slot", field_type: U32, source: Target, description: "" }}, datum_type: F32, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:36.118457245Z } timeseries_name = hardware_component:voltage
1062026-10-30T17:59:36.124ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:36.118417924Z } timeseries_name = http_service:request_latency_histogram
1072026-10-30T17:59:36.124ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:36.118402464Z } timeseries_name = oximeter_collector:collections
1082026-10-30T17:59:36.124ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:samples_collected"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:36.118414704Z } timeseries_name = oximeter_collector:samples_collected
1092026-10-30T17:59:36.182ZDEBGoximeter (clickhouse-client): inserting 12 new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae
1102026-10-30T17:59:36.186ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 4 table_name = fields_ipaddr
1112026-10-30T17:59:36.190ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 554 table_name = fields_string
1122026-10-30T17:59:36.192ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 40 table_name = fields_u16
1132026-10-30T17:59:36.193ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 120 table_name = fields_u32
1142026-10-30T17:59:36.195ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 170 table_name = fields_uuid
1152026-10-30T17:59:36.197ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 2 table_name = measurements_cumulativeu64
1162026-10-30T17:59:36.205ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 12792 table_name = measurements_f32
1172026-10-30T17:59:36.208ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 36 table_name = measurements_histogramu64
1182026-10-30T17:59:36.210ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 18 table_name = measurements_i64
1192026-10-30T17:59:36.219ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1202026-10-30T17:59:36.704ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = 1abd7ef2-712a-4900-bf45-ff2ada90a7e8 producer_ip = fd00:1122:3344:101::b producer_port = 59935
1212026-10-30T17:59:37.881ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = 44a910ca-1269-4d56-ac16-e730789a9827 producer_ip = fd00:1122:3344:101::1 producer_port = 40578
1222026-10-30T17:59:37.881ZDEBGoximeter (collection-task): collecting from producer collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = 44a910ca-1269-4d56-ac16-e730789a9827 producer_ip = fd00:1122:3344:101::1 producer_port = 40578
1232026-10-30T17:59:38.066ZDEBGoximeter (collection-task): collected results from producer collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 6634 producer_id = 44a910ca-1269-4d56-ac16-e730789a9827 producer_ip = fd00:1122:3344:101::1 producer_port = 40578
1242026-10-30T17:59:38.080ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d n_samples = 6636
1252026-10-30T17:59:38.080ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d n_samples = 6636
1262026-10-30T17:59:38.080ZDEBGoximeter (clickhouse-client): unrolling 6636 total samples collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae
1272026-10-30T17:59:38.081ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae
1282026-10-30T17:59:38.109ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:in_uft_evictions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:38.081358463Z } timeseries_name = opte_port:in_uft_evictions
1292026-10-30T17:59:38.109ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:in_uft_flows"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:38.081355623Z } timeseries_name = opte_port:in_uft_flows
1302026-10-30T17:59:38.109ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:in_uft_hits"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:38.081352653Z } timeseries_name = opte_port:in_uft_hits
1312026-10-30T17:59:38.109ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:in_uft_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:38.081354123Z } timeseries_name = opte_port:in_uft_misses
1322026-10-30T17:59:38.109ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:out_uft_evictions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:38.081364023Z } timeseries_name = opte_port:out_uft_evictions
1332026-10-30T17:59:38.109ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:out_uft_flows"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:38.081362673Z } timeseries_name = opte_port:out_uft_flows
1342026-10-30T17:59:38.109ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:out_uft_hits"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:38.081359903Z } timeseries_name = opte_port:out_uft_hits
1352026-10-30T17:59:38.109ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:out_uft_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:38.081361293Z } timeseries_name = opte_port:out_uft_misses
1362026-10-30T17:59:38.109ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:route_cache_hits"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:38.081366623Z } timeseries_name = opte_port:route_cache_hits
1372026-10-30T17:59:38.109ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:route_cache_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:38.081368273Z } timeseries_name = opte_port:route_cache_misses
1382026-10-30T17:59:38.110ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:route_cache_occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:38.081365333Z } timeseries_name = opte_port:route_cache_occupancy
1392026-10-30T17:59:38.110ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("opte_port:route_cache_table_full"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "interface_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "interface_kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "parent_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "port_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:38.081369873Z } timeseries_name = opte_port:route_cache_table_full
1402026-10-30T17:59:38.110ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_cpu:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "cpu_id", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:38.080949473Z } timeseries_name = sled_cpu:cpu_nsec
1412026-10-30T17:59:38.110ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:38.080925122Z } timeseries_name = sled_data_link:bytes_received
1422026-10-30T17:59:38.110ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:38.080927842Z } timeseries_name = sled_data_link:bytes_sent
1432026-10-30T17:59:38.110ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:38.080921372Z } timeseries_name = sled_data_link:errors_received
1442026-10-30T17:59:38.110ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:38.080923252Z } timeseries_name = sled_data_link:errors_sent
1452026-10-30T17:59:38.110ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:38.080926652Z } timeseries_name = sled_data_link:packets_received
1462026-10-30T17:59:38.110ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:38.080929492Z } timeseries_name = sled_data_link:packets_sent
1472026-10-30T17:59:38.110ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_dataset:bytes_used"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "dataset_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "dataset_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "dataset_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:38.081872816Z } timeseries_name = zfs_dataset:bytes_used
1482026-10-30T17:59:38.110ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_pool:bytes_allocated"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:38.081864035Z } timeseries_name = zfs_pool:bytes_allocated
1492026-10-30T17:59:38.110ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_pool:bytes_total"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:38.081866105Z } timeseries_name = zfs_pool:bytes_total
1502026-10-30T17:59:38.111ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("zone:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_type", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:38.081450235Z } timeseries_name = zone:cpu_nsec
1512026-10-30T17:59:38.137ZDEBGoximeter (clickhouse-client): inserting 23 new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae
1522026-10-30T17:59:38.141ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 4 table_name = fields_ipaddr
1532026-10-30T17:59:38.144ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 3567 table_name = fields_string
1542026-10-30T17:59:38.146ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 14 table_name = fields_u16
1552026-10-30T17:59:38.148ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 1025 table_name = fields_u32
1562026-10-30T17:59:38.151ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 2099 table_name = fields_uuid
1572026-10-30T17:59:38.155ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 6080 table_name = measurements_cumulativeu64
1582026-10-30T17:59:38.157ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 10 table_name = measurements_histogramu64
1592026-10-30T17:59:38.159ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 546 table_name = measurements_u64
1602026-10-30T17:59:38.182ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1612026-10-30T17:59:39.472ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d
1622026-10-30T17:59:39.472ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d
1632026-10-30T17:59:43.124ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = 35e9b228-bf62-40ed-b89a-20c8f91dcedb producer_ip = fd00:1122:3344:101::2 producer_port = 47275
1642026-10-30T17:59:43.124ZDEBGoximeter (collection-task): collecting from producer collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = 35e9b228-bf62-40ed-b89a-20c8f91dcedb producer_ip = fd00:1122:3344:101::2 producer_port = 47275
1652026-10-30T17:59:43.142ZDEBGoximeter (collection-task): collected results from producer collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 35e9b228-bf62-40ed-b89a-20c8f91dcedb producer_ip = fd00:1122:3344:101::2 producer_port = 47275
1662026-10-30T17:59:44.471ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d n_samples = 140
1672026-10-30T17:59:44.471ZDEBGoximeter (clickhouse-client): unrolling 140 total samples collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae
1682026-10-30T17:59:44.471ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d n_samples = 140
1692026-10-30T17:59:44.472ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae
1702026-10-30T17:59:44.478ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:44.471960343Z } timeseries_name = dendrite:sample_collection_duration
1712026-10-30T17:59:44.478ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:44.471884061Z } timeseries_name = switch_data_link:link_enabled
1722026-10-30T17:59:44.478ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:44.471892501Z } timeseries_name = switch_data_link:link_up
1732026-10-30T17:59:44.478ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:44.471899102Z } timeseries_name = switch_table:capacity
1742026-10-30T17:59:44.478ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:44.471919832Z } timeseries_name = switch_table:collisions
1752026-10-30T17:59:44.478ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:44.471927592Z } timeseries_name = switch_table:delete_misses
1762026-10-30T17:59:44.478ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:44.471911522Z } timeseries_name = switch_table:deletes
1772026-10-30T17:59:44.478ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:44.471931602Z } timeseries_name = switch_table:exhaustion
1782026-10-30T17:59:44.478ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:44.471907882Z } timeseries_name = switch_table:inserts
1792026-10-30T17:59:44.478ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:44.471903512Z } timeseries_name = switch_table:occupancy
1802026-10-30T17:59:44.478ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:44.471923982Z } timeseries_name = switch_table:update_misses
1812026-10-30T17:59:44.478ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-10-30T17:59:44.471915592Z } timeseries_name = switch_table:updates
1822026-10-30T17:59:44.481ZDEBGoximeter (clickhouse-client): inserting 12 new timeseries schema collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae
1832026-10-30T17:59:44.485ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 280 table_name = fields_i16
1842026-10-30T17:59:44.486ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 721 table_name = fields_string
1852026-10-30T17:59:44.488ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 140 table_name = fields_u16
1862026-10-30T17:59:44.489ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 145 table_name = fields_u32
1872026-10-30T17:59:44.490ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 144 table_name = fields_u8
1882026-10-30T17:59:44.492ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 420 table_name = fields_uuid
1892026-10-30T17:59:44.493ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 4 table_name = measurements_bool
1902026-10-30T17:59:44.495ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 105 table_name = measurements_cumulativeu64
1912026-10-30T17:59:44.496ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 1 table_name = measurements_f64
1922026-10-30T17:59:44.497ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 30 table_name = measurements_u64
1932026-10-30T17:59:44.573ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1942026-10-30T17:59:45.117ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = 1abd7ef2-712a-4900-bf45-ff2ada90a7e8 producer_ip = fd00:1122:3344:101::b producer_port = 59935
1952026-10-30T17:59:45.117ZDEBGoximeter (collection-task): collecting from producer collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = 1abd7ef2-712a-4900-bf45-ff2ada90a7e8 producer_ip = fd00:1122:3344:101::b producer_port = 59935
1962026-10-30T17:59:45.119ZDEBGoximeter (collection-task): collected results from producer collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d n_results = 6 n_samples = 24 producer_id = 1abd7ef2-712a-4900-bf45-ff2ada90a7e8 producer_ip = fd00:1122:3344:101::b producer_port = 59935
1972026-10-30T17:59:45.282ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = cf1bb4b7-8a25-4125-a72a-66834ddf1448 producer_ip = fd00:1122:3344:101::2 producer_port = 62022
1982026-10-30T17:59:45.282ZDEBGoximeter (collection-task): collecting from producer collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = cf1bb4b7-8a25-4125-a72a-66834ddf1448 producer_ip = fd00:1122:3344:101::2 producer_port = 62022
1992026-10-30T17:59:45.291ZDEBGoximeter (collection-task): collected results from producer collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 714 producer_id = cf1bb4b7-8a25-4125-a72a-66834ddf1448 producer_ip = fd00:1122:3344:101::2 producer_port = 62022
2002026-10-30T17:59:49.472ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d n_samples = 738
2012026-10-30T17:59:49.472ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d n_samples = 738
2022026-10-30T17:59:49.472ZDEBGoximeter (clickhouse-client): unrolling 738 total samples collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae
2032026-10-30T17:59:49.472ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae
2042026-10-30T17:59:49.481ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 552 table_name = fields_string
2052026-10-30T17:59:49.482ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 36 table_name = fields_u16
2062026-10-30T17:59:49.483ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 120 table_name = fields_u32
2072026-10-30T17:59:49.485ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 156 table_name = fields_uuid
2082026-10-30T17:59:49.486ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 702 table_name = measurements_f32
2092026-10-30T17:59:49.488ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 36 table_name = measurements_histogramu64
2102026-10-30T17:59:49.520ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:626
2112026-10-30T17:59:49.520ZDEBGoximeter: client request body = None method = GET operation_id = cpapi_assigned_producers_list uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a24d1464-46d3-4d98-b287-671ce5086a07/producers?sort_by=id_ascending
2122026-10-30T17:59:49.524ZDEBGoximeter: client response operation_id = cpapi_assigned_producers_list result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a24d1464-46d3-4d98-b287-671ce5086a07/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "7771e418-05c8-4b05-90d9-3597e14c5165", "content-length": "866", "date": "Fri, 30 Oct 2026 17:59:49 GMT"} })
2132026-10-30T17:59:49.524ZDEBGoximeter: client request body = None method = GET operation_id = cpapi_assigned_producers_list uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a24d1464-46d3-4d98-b287-671ce5086a07/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZjFiYjRiNy04YTI1LTQxMjUtYTcyYS02NjgzNGRkZjE0NDgifX0%3D
2142026-10-30T17:59:49.529ZDEBGoximeter: client response operation_id = cpapi_assigned_producers_list result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/a24d1464-46d3-4d98-b287-671ce5086a07/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZjFiYjRiNy04YTI1LTQxMjUtYTcyYS02NjgzNGRkZjE0NDgifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "46fe4b60-f1c6-43ab-8bc3-c81162ae415d", "content-length": "29", "date": "Fri, 30 Oct 2026 17:59:49 GMT"} })
2152026-10-30T17:59:49.529ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:53963 collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = 35e9b228-bf62-40ed-b89a-20c8f91dceda
2162026-10-30T17:59:49.529ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:701 n_current_tasks = 5 n_pruned_tasks = 0
2172026-10-30T17:59:49.573ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2182026-10-30T17:59:53.124ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = 35e9b228-bf62-40ed-b89a-20c8f91dcedb producer_ip = fd00:1122:3344:101::2 producer_port = 47275
2192026-10-30T17:59:53.124ZDEBGoximeter (collection-task): collecting from producer collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = 35e9b228-bf62-40ed-b89a-20c8f91dcedb producer_ip = fd00:1122:3344:101::2 producer_port = 47275
2202026-10-30T17:59:53.133ZDEBGoximeter (collection-task): collected results from producer collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 35e9b228-bf62-40ed-b89a-20c8f91dcedb producer_ip = fd00:1122:3344:101::2 producer_port = 47275
2212026-10-30T17:59:54.472ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d n_samples = 140
2222026-10-30T17:59:54.472ZDEBGoximeter (clickhouse-client): unrolling 140 total samples collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae
2232026-10-30T17:59:54.472ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d n_samples = 140
2242026-10-30T17:59:54.472ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae
2252026-10-30T17:59:54.479ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 280 table_name = fields_i16
2262026-10-30T17:59:54.481ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 721 table_name = fields_string
2272026-10-30T17:59:54.482ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 140 table_name = fields_u16
2282026-10-30T17:59:54.484ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 145 table_name = fields_u32
2292026-10-30T17:59:54.485ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 144 table_name = fields_u8
2302026-10-30T17:59:54.487ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 420 table_name = fields_uuid
2312026-10-30T17:59:54.488ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 4 table_name = measurements_bool
2322026-10-30T17:59:54.489ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 105 table_name = measurements_cumulativeu64
2332026-10-30T17:59:54.491ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 1 table_name = measurements_f64
2342026-10-30T17:59:54.492ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 30 table_name = measurements_u64
2352026-10-30T17:59:54.573ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2362026-10-30T17:59:55.118ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = 1abd7ef2-712a-4900-bf45-ff2ada90a7e8 producer_ip = fd00:1122:3344:101::b producer_port = 59935
2372026-10-30T17:59:55.118ZDEBGoximeter (collection-task): collecting from producer collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = 1abd7ef2-712a-4900-bf45-ff2ada90a7e8 producer_ip = fd00:1122:3344:101::b producer_port = 59935
2382026-10-30T17:59:55.121ZDEBGoximeter (collection-task): collected results from producer collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d n_results = 6 n_samples = 24 producer_id = 1abd7ef2-712a-4900-bf45-ff2ada90a7e8 producer_ip = fd00:1122:3344:101::b producer_port = 59935
2392026-10-30T17:59:55.282ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = cf1bb4b7-8a25-4125-a72a-66834ddf1448 producer_ip = fd00:1122:3344:101::2 producer_port = 62022
2402026-10-30T17:59:55.282ZDEBGoximeter (collection-task): collecting from producer collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d producer_id = cf1bb4b7-8a25-4125-a72a-66834ddf1448 producer_ip = fd00:1122:3344:101::2 producer_port = 62022
2412026-10-30T17:59:55.293ZDEBGoximeter (collection-task): collected results from producer collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 792 producer_id = cf1bb4b7-8a25-4125-a72a-66834ddf1448 producer_ip = fd00:1122:3344:101::2 producer_port = 62022
2422026-10-30T17:59:59.471ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d n_samples = 816
2432026-10-30T17:59:59.471ZDEBGoximeter (database-inserter): inserting samples into database collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d n_samples = 816
2442026-10-30T17:59:59.471ZDEBGoximeter (clickhouse-client): unrolling 816 total samples collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae
2452026-10-30T17:59:59.472ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae
2462026-10-30T17:59:59.481ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 552 table_name = fields_string
2472026-10-30T17:59:59.483ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 36 table_name = fields_u16
2482026-10-30T17:59:59.484ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 120 table_name = fields_u32
2492026-10-30T17:59:59.486ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 156 table_name = fields_uuid
2502026-10-30T17:59:59.487ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 780 table_name = measurements_f32
2512026-10-30T17:59:59.489ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d id = 5df25a8d-b25f-48b1-9ea6-b848f15875ae n_rows = 36 table_name = measurements_histogramu64
2522026-10-30T17:59:59.573ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = a24d1464-46d3-4d98-b287-671ce5086a07 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276