Max level shown:
1 [ Jan 17 03:59:17 Enabled. ]
2 [ Jan 17 03:59:17 Rereading configuration. ]
3 [ Jan 17 03:59:19 Rereading configuration. ]
4 [ Jan 17 03:59:27 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id ec0d5f27-7372-4a77-89eb-330f081463fa &"). ]
5 [ Jan 17 03:59:27 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-01-17T03:59:28.425ZDEBGoximeter: registered DTrace probes
82026-01-17T03:59:28.428ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:264
92026-01-17T03:59:28.442ZDEBGoximeter: creating ClickHouse client
102026-01-17T03:59:28.508ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
112026-01-17T03:59:32.365ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:900 id = 02522d81-b11c-4756-b784-ef796aac2ad6
122026-01-17T03:59:32.365ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d
132026-01-17T03:59:32.365ZINFOoximeter (clickhouse-client): reading db version collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:800 id = 02522d81-b11c-4756-b784-ef796aac2ad6
142026-01-17T03:59:32.367ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:900 id = 02522d81-b11c-4756-b784-ef796aac2ad6
152026-01-17T03:59:32.367ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:805 id = 02522d81-b11c-4756-b784-ef796aac2ad6 version = 0
162026-01-17T03:59:32.367ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:810 id = 02522d81-b11c-4756-b784-ef796aac2ad6
172026-01-17T03:59:32.367ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
182026-01-17T03:59:32.708ZINFOoximeter (clickhouse-client): inserting current version collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:831 id = 02522d81-b11c-4756-b784-ef796aac2ad6 version = 14
192026-01-17T03:59:32.748ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = b021ee45-adca-403b-975e-65e03fd8875e
202026-01-17T03:59:32.779ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-01-17T03:59:32.779ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-01-17T03:59:32.779ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-01-17T03:59:32.779ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-01-17T03:59:32.779ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.6/src/server.rs:328 local_addr = [fd00:1122:3344:101::d]:12223
252026-01-17T03:59:32.795ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-01-17T03:59:32.795ZDEBGoximeter: registered USDT probes
272026-01-17T03:59:32.795ZDEBGoximeter: contacting nexus
282026-01-17T03:59:32.959ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
292026-01-17T03:59:32.961ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::c]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
302026-01-17T03:59:32.961ZWARNoximeter: failed to contact nexus, will retry in 179.661456ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:409
312026-01-17T03:59:33.142ZDEBGoximeter: contacting nexus
322026-01-17T03:59:33.143ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
332026-01-17T03:59:33.143ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::c]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
342026-01-17T03:59:33.143ZWARNoximeter: failed to contact nexus, will retry in 260.217566ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:409
352026-01-17T03:59:33.405ZDEBGoximeter: contacting nexus
362026-01-17T03:59:33.405ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
372026-01-17T03:59:33.405ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::c]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
382026-01-17T03:59:33.405ZWARNoximeter: failed to contact nexus, will retry in 507.794549ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:409
392026-01-17T03:59:33.914ZDEBGoximeter: contacting nexus
402026-01-17T03:59:33.914ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
412026-01-17T03:59:33.914ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::c]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
422026-01-17T03:59:33.914ZWARNoximeter: failed to contact nexus, will retry in 1.371044191s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:409
432026-01-17T03:59:35.286ZDEBGoximeter: contacting nexus
442026-01-17T03:59:35.287ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
452026-01-17T03:59:35.287ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
462026-01-17T03:59:35.287ZWARNoximeter: failed to contact nexus, will retry in 5.66019684s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:409
472026-01-17T03:59:40.949ZDEBGoximeter: contacting nexus
482026-01-17T03:59:40.949ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
492026-01-17T03:59:40.992ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "df2f7a54-1522-4e1c-9687-0ef0e897dcfe", "date": "Sat, 17 Jan 2026 03:59:40 GMT"} })
502026-01-17T03:59:40.992ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:427 id = ec0d5f27-7372-4a77-89eb-330f081463fa
512026-01-17T03:59:40.992ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:554
522026-01-17T03:59:40.993ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
532026-01-17T03:59:40.997ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/ec0d5f27-7372-4a77-89eb-330f081463fa/producers?sort_by=id_ascending
542026-01-17T03:59:41.140ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/ec0d5f27-7372-4a77-89eb-330f081463fa/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6f221a0-2587-4b74-b4a6-7752b32094af", "content-length": "29", "date": "Sat, 17 Jan 2026 03:59:41 GMT"} })
552026-01-17T03:59:41.140ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 0 n_pruned_tasks = 0
562026-01-17T03:59:55.993ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
572026-01-17T03:59:55.993ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/ec0d5f27-7372-4a77-89eb-330f081463fa/producers?sort_by=id_ascending
582026-01-17T03:59:56.004ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/ec0d5f27-7372-4a77-89eb-330f081463fa/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "51efcd59-0db4-4070-818a-1e9ef832b27d", "content-length": "857", "date": "Sat, 17 Jan 2026 03:59:56 GMT"} })
592026-01-17T03:59:56.016ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/ec0d5f27-7372-4a77-89eb-330f081463fa/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4Njg1MzNmMy1iMGZmLTQ3NWYtOTRmNy0wMjYyMjFiODI2ZWYifX0%3D
602026-01-17T03:59:56.019ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/ec0d5f27-7372-4a77-89eb-330f081463fa/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4Njg1MzNmMy1iMGZmLTQ3NWYtOTRmNy0wMjYyMjFiODI2ZWYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "080b40bb-6b9e-43ad-828d-9f99fc7059c3", "content-length": "29", "date": "Sat, 17 Jan 2026 03:59:56 GMT"} })
612026-01-17T03:59:56.019ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 10779025-cdbb-4a4c-9588-13229f73c13e
622026-01-17T03:59:56.019ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:33466 collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 3048d4ef-bd0a-4347-9fcf-a43bdcc8b889
632026-01-17T03:59:56.019ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 50534083-20e1-4207-832d-daabc8cfff14
642026-01-17T03:59:56.019ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 7c44d0a3-ce86-41ed-81b6-d1a2bb4beb52
652026-01-17T03:59:56.019ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:62544 collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 868533f3-b0ff-475f-94f7-026221b826ef
662026-01-17T03:59:56.019ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 5 n_pruned_tasks = 0
672026-01-17T03:59:56.020ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 50534083-20e1-4207-832d-daabc8cfff14 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
682026-01-17T03:59:56.020ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 868533f3-b0ff-475f-94f7-026221b826ef producer_ip = fd00:1122:3344:101::2 producer_port = 62544
692026-01-17T03:59:56.020ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 10779025-cdbb-4a4c-9588-13229f73c13e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
702026-01-17T03:59:56.020ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 3048d4ef-bd0a-4347-9fcf-a43bdcc8b889 producer_ip = fd00:1122:3344:101::2 producer_port = 33466
712026-01-17T03:59:56.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 7c44d0a3-ce86-41ed-81b6-d1a2bb4beb52 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
722026-01-17T03:59:56.020ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 7c44d0a3-ce86-41ed-81b6-d1a2bb4beb52 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
732026-01-17T03:59:56.084ZDEBGoximeter (collection-task): collecting from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 7c44d0a3-ce86-41ed-81b6-d1a2bb4beb52 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
742026-01-17T03:59:56.115ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 3048d4ef-bd0a-4347-9fcf-a43bdcc8b889 producer_ip = fd00:1122:3344:101::2 producer_port = 33466
752026-01-17T03:59:56.115ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 10779025-cdbb-4a4c-9588-13229f73c13e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
762026-01-17T03:59:56.115ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 50534083-20e1-4207-832d-daabc8cfff14 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
772026-01-17T03:59:56.115ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 868533f3-b0ff-475f-94f7-026221b826ef producer_ip = fd00:1122:3344:101::2 producer_port = 62544
782026-01-17T03:59:56.116ZDEBGoximeter (collection-task): collected results from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7c44d0a3-ce86-41ed-81b6-d1a2bb4beb52 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
792026-01-17T03:59:56.131ZDEBGoximeter (collection-task): collecting from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 3048d4ef-bd0a-4347-9fcf-a43bdcc8b889 producer_ip = fd00:1122:3344:101::2 producer_port = 33466
802026-01-17T03:59:56.144ZDEBGoximeter (collection-task): collected results from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 3048d4ef-bd0a-4347-9fcf-a43bdcc8b889 producer_ip = fd00:1122:3344:101::2 producer_port = 33466
812026-01-17T03:59:56.224ZDEBGoximeter (collection-task): collecting from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 10779025-cdbb-4a4c-9588-13229f73c13e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
822026-01-17T03:59:56.286ZDEBGoximeter (collection-task): collecting from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 50534083-20e1-4207-832d-daabc8cfff14 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
832026-01-17T03:59:56.291ZDEBGoximeter (collection-task): collecting from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 868533f3-b0ff-475f-94f7-026221b826ef producer_ip = fd00:1122:3344:101::2 producer_port = 62544
842026-01-17T03:59:56.292ZDEBGoximeter (collection-task): collected results from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 10779025-cdbb-4a4c-9588-13229f73c13e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
852026-01-17T03:59:56.296ZDEBGoximeter (collection-task): collected results from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 50534083-20e1-4207-832d-daabc8cfff14 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
862026-01-17T03:59:56.350ZDEBGoximeter (collection-task): collected results from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 868533f3-b0ff-475f-94f7-026221b826ef producer_ip = fd00:1122:3344:101::2 producer_port = 62544
872026-01-17T03:59:57.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 7c44d0a3-ce86-41ed-81b6-d1a2bb4beb52 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
882026-01-17T03:59:57.020ZDEBGoximeter (collection-task): collecting from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 7c44d0a3-ce86-41ed-81b6-d1a2bb4beb52 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
892026-01-17T03:59:57.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 50534083-20e1-4207-832d-daabc8cfff14 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
902026-01-17T03:59:57.021ZDEBGoximeter (collection-task): collecting from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 50534083-20e1-4207-832d-daabc8cfff14 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
912026-01-17T03:59:57.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 10779025-cdbb-4a4c-9588-13229f73c13e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
922026-01-17T03:59:57.021ZDEBGoximeter (collection-task): collecting from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 10779025-cdbb-4a4c-9588-13229f73c13e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
932026-01-17T03:59:57.021ZDEBGoximeter (collection-task): collected results from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 50534083-20e1-4207-832d-daabc8cfff14 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
942026-01-17T03:59:57.022ZDEBGoximeter (collection-task): collected results from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7c44d0a3-ce86-41ed-81b6-d1a2bb4beb52 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
952026-01-17T03:59:57.023ZDEBGoximeter (collection-task): collected results from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 10779025-cdbb-4a4c-9588-13229f73c13e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
962026-01-17T03:59:57.751ZDEBGoximeter (results-sink-cluster): inserting 308 samples into database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d
972026-01-17T03:59:57.751ZDEBGoximeter (results-sink): inserting 308 samples into database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d
982026-01-17T03:59:57.751ZDEBGoximeter (clickhouse-client): unrolling 308 total samples collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
992026-01-17T03:59:57.751ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1002026-01-17T03:59:57.781ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.751917402Z } timeseries_name = oximeter_collector:collections
1012026-01-17T03:59:57.795ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1022026-01-17T03:59:57.810ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.795571941Z } timeseries_name = ddm_router:originated_underlay_prefixes
1032026-01-17T03:59:57.810ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1042026-01-17T03:59:57.823ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.810950782Z } timeseries_name = ddm_router:originated_tunnel_endpoints
1052026-01-17T03:59:57.823ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1062026-01-17T03:59:57.824ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.823763288Z } timeseries_name = ddm_session:solicitations_sent
1072026-01-17T03:59:57.824ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1082026-01-17T03:59:57.825ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.824718538Z } timeseries_name = ddm_session:solicitations_received
1092026-01-17T03:59:57.825ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1102026-01-17T03:59:57.826ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.825655408Z } timeseries_name = ddm_session:advertisements_sent
1112026-01-17T03:59:57.826ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1122026-01-17T03:59:57.827ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.826580598Z } timeseries_name = ddm_session:advertisements_received
1132026-01-17T03:59:57.827ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1142026-01-17T03:59:57.828ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.827499558Z } timeseries_name = ddm_session:peer_expirations
1152026-01-17T03:59:57.828ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1162026-01-17T03:59:57.829ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.828424218Z } timeseries_name = ddm_session:peer_address_changes
1172026-01-17T03:59:57.829ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1182026-01-17T03:59:57.830ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.829441160Z } timeseries_name = ddm_session:peer_sessions_established
1192026-01-17T03:59:57.830ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1202026-01-17T03:59:57.831ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.830450862Z } timeseries_name = ddm_session:updates_sent
1212026-01-17T03:59:57.831ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1222026-01-17T03:59:57.832ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.831384572Z } timeseries_name = ddm_session:updates_received
1232026-01-17T03:59:57.832ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1242026-01-17T03:59:57.833ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.832320112Z } timeseries_name = ddm_session:update_send_fail
1252026-01-17T03:59:57.833ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1262026-01-17T03:59:57.834ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.833265562Z } timeseries_name = ddm_session:imported_underlay_prefixes
1272026-01-17T03:59:57.834ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1282026-01-17T03:59:57.835ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.834178692Z } timeseries_name = ddm_session:imported_tunnel_endpoints
1292026-01-17T03:59:57.835ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1302026-01-17T03:59:57.836ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.835137452Z } timeseries_name = http_service:request_latency_histogram
1312026-01-17T03:59:57.837ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1322026-01-17T03:59:57.838ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.837770089Z } timeseries_name = static_routing_config:static_routes
1332026-01-17T03:59:57.838ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1342026-01-17T03:59:57.839ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.838835212Z } timeseries_name = static_routing_config:static_nexthops
1352026-01-17T03:59:57.839ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1362026-01-17T03:59:57.840ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.839785232Z } timeseries_name = switch_rib:active_routes
1372026-01-17T03:59:57.840ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1382026-01-17T03:59:57.841ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.840731613Z } timeseries_name = mg_lower:routes_blocked_by_link_state
1392026-01-17T03:59:57.841ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1402026-01-17T03:59:57.842ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.841641422Z } timeseries_name = switch_data_link:link_enabled
1412026-01-17T03:59:57.842ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1422026-01-17T03:59:57.843ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.842626674Z } timeseries_name = switch_data_link:link_up
1432026-01-17T03:59:57.843ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1442026-01-17T03:59:57.844ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.843867020Z } timeseries_name = switch_table:capacity
1452026-01-17T03:59:57.844ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1462026-01-17T03:59:57.845ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.844812161Z } timeseries_name = switch_table:occupancy
1472026-01-17T03:59:57.845ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1482026-01-17T03:59:57.846ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.845772541Z } timeseries_name = switch_table:inserts
1492026-01-17T03:59:57.846ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1502026-01-17T03:59:57.847ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.846696161Z } timeseries_name = switch_table:deletes
1512026-01-17T03:59:57.847ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1522026-01-17T03:59:57.848ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.847641761Z } timeseries_name = switch_table:updates
1532026-01-17T03:59:57.848ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1542026-01-17T03:59:57.849ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.848587192Z } timeseries_name = switch_table:collisions
1552026-01-17T03:59:57.849ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1562026-01-17T03:59:57.850ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.849597523Z } timeseries_name = switch_table:update_misses
1572026-01-17T03:59:57.850ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1582026-01-17T03:59:57.851ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.850572495Z } timeseries_name = switch_table:delete_misses
1592026-01-17T03:59:57.851ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1602026-01-17T03:59:57.852ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.851524985Z } timeseries_name = switch_table:exhaustion
1612026-01-17T03:59:57.854ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
1622026-01-17T03:59:57.864ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1632026-01-17T03:59:57.865ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-17T03:59:57.864351401Z } timeseries_name = dendrite:sample_collection_duration
1642026-01-17T03:59:57.866ZDEBGoximeter (clickhouse-client): inserting 32 new timeseries schema collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6
1652026-01-17T03:59:57.879ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 n_rows = 410 table_name = fields_i16
1662026-01-17T03:59:57.881ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 n_rows = 10 table_name = fields_ipaddr
1672026-01-17T03:59:57.884ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 n_rows = 1137 table_name = fields_string
1682026-01-17T03:59:57.886ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 n_rows = 225 table_name = fields_u16
1692026-01-17T03:59:57.888ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 n_rows = 212 table_name = fields_u32
1702026-01-17T03:59:57.892ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 n_rows = 211 table_name = fields_u8
1712026-01-17T03:59:57.894ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 n_rows = 699 table_name = fields_uuid
1722026-01-17T03:59:57.902ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 n_rows = 6 table_name = measurements_bool
1732026-01-17T03:59:57.906ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 n_rows = 223 table_name = measurements_cumulativeu64
1742026-01-17T03:59:57.908ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 n_rows = 1 table_name = measurements_f64
1752026-01-17T03:59:57.914ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 n_rows = 10 table_name = measurements_histogramu64
1762026-01-17T03:59:57.915ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d id = 02522d81-b11c-4756-b784-ef796aac2ad6 n_rows = 68 table_name = measurements_u64
1772026-01-17T03:59:58.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 7c44d0a3-ce86-41ed-81b6-d1a2bb4beb52 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1782026-01-17T03:59:58.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 50534083-20e1-4207-832d-daabc8cfff14 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1792026-01-17T03:59:58.020ZDEBGoximeter (collection-task): collecting from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 7c44d0a3-ce86-41ed-81b6-d1a2bb4beb52 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1802026-01-17T03:59:58.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 10779025-cdbb-4a4c-9588-13229f73c13e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1812026-01-17T03:59:58.020ZDEBGoximeter (collection-task): collecting from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 50534083-20e1-4207-832d-daabc8cfff14 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1822026-01-17T03:59:58.020ZDEBGoximeter (collection-task): collecting from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 10779025-cdbb-4a4c-9588-13229f73c13e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1832026-01-17T03:59:58.021ZDEBGoximeter (collection-task): collected results from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 50534083-20e1-4207-832d-daabc8cfff14 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1842026-01-17T03:59:58.021ZDEBGoximeter (collection-task): collected results from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7c44d0a3-ce86-41ed-81b6-d1a2bb4beb52 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1852026-01-17T03:59:58.022ZDEBGoximeter (collection-task): collected results from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 10779025-cdbb-4a4c-9588-13229f73c13e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1862026-01-17T03:59:59.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 7c44d0a3-ce86-41ed-81b6-d1a2bb4beb52 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1872026-01-17T03:59:59.021ZDEBGoximeter (collection-task): collecting from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 7c44d0a3-ce86-41ed-81b6-d1a2bb4beb52 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1882026-01-17T03:59:59.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 10779025-cdbb-4a4c-9588-13229f73c13e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1892026-01-17T03:59:59.021ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 50534083-20e1-4207-832d-daabc8cfff14 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1902026-01-17T03:59:59.021ZDEBGoximeter (collection-task): collecting from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 10779025-cdbb-4a4c-9588-13229f73c13e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1912026-01-17T03:59:59.021ZDEBGoximeter (collection-task): collecting from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 50534083-20e1-4207-832d-daabc8cfff14 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1922026-01-17T03:59:59.021ZDEBGoximeter (collection-task): collected results from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 50534083-20e1-4207-832d-daabc8cfff14 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1932026-01-17T03:59:59.022ZDEBGoximeter (collection-task): collected results from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7c44d0a3-ce86-41ed-81b6-d1a2bb4beb52 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1942026-01-17T03:59:59.023ZDEBGoximeter (collection-task): collected results from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 10779025-cdbb-4a4c-9588-13229f73c13e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1952026-01-17T04:00:00.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 7c44d0a3-ce86-41ed-81b6-d1a2bb4beb52 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1962026-01-17T04:00:00.020ZDEBGoximeter (collection-task): collecting from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 7c44d0a3-ce86-41ed-81b6-d1a2bb4beb52 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1972026-01-17T04:00:00.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 50534083-20e1-4207-832d-daabc8cfff14 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1982026-01-17T04:00:00.020ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 10779025-cdbb-4a4c-9588-13229f73c13e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1992026-01-17T04:00:00.020ZDEBGoximeter (collection-task): collecting from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 50534083-20e1-4207-832d-daabc8cfff14 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2002026-01-17T04:00:00.021ZDEBGoximeter (collection-task): collecting from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d producer_id = 10779025-cdbb-4a4c-9588-13229f73c13e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2012026-01-17T04:00:00.021ZDEBGoximeter (collection-task): collected results from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 50534083-20e1-4207-832d-daabc8cfff14 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2022026-01-17T04:00:00.022ZDEBGoximeter (collection-task): collected results from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7c44d0a3-ce86-41ed-81b6-d1a2bb4beb52 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2032026-01-17T04:00:00.023ZDEBGoximeter (collection-task): collected results from producer collector_id = ec0d5f27-7372-4a77-89eb-330f081463fa collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 10779025-cdbb-4a4c-9588-13229f73c13e producer_ip = fd00:1122:3344:101::1 producer_port = 8001