Max level shown:
1 [ Jan 13 18:58:17 Enabled. ]
2 [ Jan 13 18:58:17 Rereading configuration. ]
3 [ Jan 13 18:58:19 Rereading configuration. ]
4 [ Jan 13 18:58:25 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id af91049d-e328-4563-b7c4-21e2beaa6862 &"). ]
5 [ Jan 13 18:58:25 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-01-13T18:58:26.073ZDEBGoximeter: registered DTrace probes
82026-01-13T18:58:26.074ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:264
92026-01-13T18:58:26.077ZDEBGoximeter: creating ClickHouse client
102026-01-13T18:58:26.087ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
112026-01-13T18:58:29.972ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:900 id = 32ba4532-f1dd-4584-9836-8732d4169388
122026-01-13T18:58:29.972ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
132026-01-13T18:58:29.972ZINFOoximeter (clickhouse-client): reading db version collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:800 id = 32ba4532-f1dd-4584-9836-8732d4169388
142026-01-13T18:58:29.973ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:900 id = 32ba4532-f1dd-4584-9836-8732d4169388
152026-01-13T18:58:29.974ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:805 id = 32ba4532-f1dd-4584-9836-8732d4169388 version = 0
162026-01-13T18:58:29.974ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:810 id = 32ba4532-f1dd-4584-9836-8732d4169388
172026-01-13T18:58:29.974ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
182026-01-13T18:58:30.183ZINFOoximeter (clickhouse-client): inserting current version collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:831 id = 32ba4532-f1dd-4584-9836-8732d4169388 version = 14
192026-01-13T18:58:30.222ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = dfed2ecf-7023-4a07-a394-a5f1af697be2
202026-01-13T18:58:30.241ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-01-13T18:58:30.241ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-01-13T18:58:30.241ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-01-13T18:58:30.241ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-01-13T18:58:30.241ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.6/src/server.rs:328 local_addr = [fd00:1122:3344:101::d]:12223
252026-01-13T18:58:30.244ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-01-13T18:58:30.244ZDEBGoximeter: registered USDT probes
272026-01-13T18:58:30.244ZDEBGoximeter: contacting nexus
282026-01-13T18:58:30.380ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
292026-01-13T18:58:30.381ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
302026-01-13T18:58:30.381ZWARNoximeter: failed to contact nexus, will retry in 297.240285ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:409
312026-01-13T18:58:30.679ZDEBGoximeter: contacting nexus
322026-01-13T18:58:30.680ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
332026-01-13T18:58:30.851ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "5c5e7cac-4d0c-4329-a502-044d1a7ad89e", "date": "Tue, 13 Jan 2026 18:58:30 GMT"} })
342026-01-13T18:58:30.851ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:427 id = af91049d-e328-4563-b7c4-21e2beaa6862
352026-01-13T18:58:30.851ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:554
362026-01-13T18:58:30.852ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
372026-01-13T18:58:30.855ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?sort_by=id_ascending
382026-01-13T18:58:30.855ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?sort_by=id_ascending", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
392026-01-13T18:58:30.856ZERROoximeter (oximeter-agent): error fetching next assigned producer, abandoning this refresh attempt collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?sort_by=id_ascending): error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?sort_by=id_ascending): client error (Connect): tcp connect error: Connection refused (os error 146) file = oximeter/collector/src/agent.rs:595
402026-01-13T18:58:45.852ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
412026-01-13T18:58:45.852ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?sort_by=id_ascending
422026-01-13T18:58:45.863ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba99bd31-f635-4de5-9dd5-7e256bccb38d", "content-length": "29", "date": "Tue, 13 Jan 2026 18:58:45 GMT"} })
432026-01-13T18:58:45.867ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 0 n_pruned_tasks = 0
442026-01-13T18:59:00.852ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
452026-01-13T18:59:00.852ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?sort_by=id_ascending
462026-01-13T18:59:00.892ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e47f7e2-62fd-4fea-9bde-a7b8ba032032", "content-length": "864", "date": "Tue, 13 Jan 2026 18:59:00 GMT"} })
472026-01-13T18:59:00.894ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWUxNGFmMS0zNTRiLTQyN2EtYjFiNC1iOTU0ZjQ2NTQ2YTYifX0%3D
482026-01-13T18:59:00.897ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWUxNGFmMS0zNTRiLTQyN2EtYjFiNC1iOTU0ZjQ2NTQ2YTYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "46dc2b1f-61ac-4cb2-a5a7-b84739e3855d", "content-length": "29", "date": "Tue, 13 Jan 2026 18:59:00 GMT"} })
492026-01-13T18:59:00.897ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:38898 collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607
502026-01-13T18:59:00.897ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:62302 collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 1a77ee0d-c128-49c7-810d-60275f214113
512026-01-13T18:59:00.897ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:47874 collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8
522026-01-13T18:59:00.897ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86
532026-01-13T18:59:00.897ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:57622 collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = c9e14af1-354b-427a-b1b4-b954f46546a6
542026-01-13T18:59:00.897ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 5 n_pruned_tasks = 0
552026-01-13T18:59:00.899ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607 producer_ip = fd00:1122:3344:101::a producer_port = 38898
562026-01-13T18:59:00.899ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
572026-01-13T18:59:00.899ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 1a77ee0d-c128-49c7-810d-60275f214113 producer_ip = fd00:1122:3344:101::2 producer_port = 62302
582026-01-13T18:59:00.899ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8 producer_ip = fd00:1122:3344:101::2 producer_port = 47874
592026-01-13T18:59:00.899ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = c9e14af1-354b-427a-b1b4-b954f46546a6 producer_ip = fd00:1122:3344:101::1 producer_port = 57622
602026-01-13T18:59:00.932ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
612026-01-13T18:59:00.932ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 1a77ee0d-c128-49c7-810d-60275f214113 producer_ip = fd00:1122:3344:101::2 producer_port = 62302
622026-01-13T18:59:00.932ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8 producer_ip = fd00:1122:3344:101::2 producer_port = 47874
632026-01-13T18:59:00.932ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = c9e14af1-354b-427a-b1b4-b954f46546a6 producer_ip = fd00:1122:3344:101::1 producer_port = 57622
642026-01-13T18:59:00.932ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607 producer_ip = fd00:1122:3344:101::a producer_port = 38898
652026-01-13T18:59:01.053ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
662026-01-13T18:59:01.067ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8 producer_ip = fd00:1122:3344:101::2 producer_port = 47874
672026-01-13T18:59:01.067ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = c9e14af1-354b-427a-b1b4-b954f46546a6 producer_ip = fd00:1122:3344:101::1 producer_port = 57622
682026-01-13T18:59:01.075ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
692026-01-13T18:59:01.079ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8 producer_ip = fd00:1122:3344:101::2 producer_port = 47874
702026-01-13T18:59:01.124ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 1a77ee0d-c128-49c7-810d-60275f214113 producer_ip = fd00:1122:3344:101::2 producer_port = 62302
712026-01-13T18:59:01.127ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607 producer_ip = fd00:1122:3344:101::a producer_port = 38898
722026-01-13T18:59:01.138ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607 producer_ip = fd00:1122:3344:101::a producer_port = 38898
732026-01-13T18:59:01.158ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1a77ee0d-c128-49c7-810d-60275f214113 producer_ip = fd00:1122:3344:101::2 producer_port = 62302
742026-01-13T18:59:01.232ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = c9e14af1-354b-427a-b1b4-b954f46546a6 producer_ip = fd00:1122:3344:101::1 producer_port = 57622
752026-01-13T18:59:01.244ZDEBGoximeter (results-sink-cluster): inserting 2821 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
762026-01-13T18:59:01.245ZDEBGoximeter (results-sink): inserting 2821 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
772026-01-13T18:59:01.245ZDEBGoximeter (clickhouse-client): unrolling 2821 total samples collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
782026-01-13T18:59:01.247ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
792026-01-13T18:59:01.248ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.247668129Z } timeseries_name = oximeter_collector:collections
802026-01-13T18:59:01.253ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
812026-01-13T18:59:01.266ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.253399921Z } timeseries_name = ddm_router:originated_underlay_prefixes
822026-01-13T18:59:01.266ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
832026-01-13T18:59:01.276ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.266665851Z } timeseries_name = ddm_router:originated_tunnel_endpoints
842026-01-13T18:59:01.276ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
852026-01-13T18:59:01.277ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.276268349Z } timeseries_name = ddm_session:solicitations_sent
862026-01-13T18:59:01.277ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
872026-01-13T18:59:01.278ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.277216637Z } timeseries_name = ddm_session:solicitations_received
882026-01-13T18:59:01.278ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
892026-01-13T18:59:01.278ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.278127595Z } timeseries_name = ddm_session:advertisements_sent
902026-01-13T18:59:01.278ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
912026-01-13T18:59:01.279ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.278982572Z } timeseries_name = ddm_session:advertisements_received
922026-01-13T18:59:01.279ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
932026-01-13T18:59:01.280ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.279848559Z } timeseries_name = ddm_session:peer_expirations
942026-01-13T18:59:01.280ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
952026-01-13T18:59:01.281ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.280715056Z } timeseries_name = ddm_session:peer_address_changes
962026-01-13T18:59:01.281ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
972026-01-13T18:59:01.282ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.281627024Z } timeseries_name = ddm_session:peer_sessions_established
982026-01-13T18:59:01.282ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
992026-01-13T18:59:01.283ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.282524681Z } timeseries_name = ddm_session:updates_sent
1002026-01-13T18:59:01.283ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1012026-01-13T18:59:01.284ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.283388746Z } timeseries_name = ddm_session:updates_received
1022026-01-13T18:59:01.284ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1032026-01-13T18:59:01.285ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.284356227Z } timeseries_name = ddm_session:update_send_fail
1042026-01-13T18:59:01.285ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1052026-01-13T18:59:01.286ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.285257715Z } timeseries_name = ddm_session:imported_underlay_prefixes
1062026-01-13T18:59:01.286ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1072026-01-13T18:59:01.286ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.286144362Z } timeseries_name = ddm_session:imported_tunnel_endpoints
1082026-01-13T18:59:01.287ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1092026-01-13T18:59:01.287ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.287046300Z } timeseries_name = http_service:request_latency_histogram
1102026-01-13T18:59:01.289ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1112026-01-13T18:59:01.291ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.289732863Z } timeseries_name = collection_target:cpus_provisioned
1122026-01-13T18:59:01.291ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1132026-01-13T18:59:01.292ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.291079909Z } timeseries_name = collection_target:ram_provisioned
1142026-01-13T18:59:01.292ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1152026-01-13T18:59:01.292ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.292070748Z } timeseries_name = collection_target:virtual_disk_space_provisioned
1162026-01-13T18:59:01.293ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1172026-01-13T18:59:01.294ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.293556308Z } timeseries_name = switch_data_link:link_enabled
1182026-01-13T18:59:01.294ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1192026-01-13T18:59:01.295ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.294576657Z } timeseries_name = switch_data_link:link_up
1202026-01-13T18:59:01.295ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1212026-01-13T18:59:01.296ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.295872843Z } timeseries_name = switch_table:capacity
1222026-01-13T18:59:01.296ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1232026-01-13T18:59:01.297ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.296833042Z } timeseries_name = switch_table:occupancy
1242026-01-13T18:59:01.297ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1252026-01-13T18:59:01.298ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.297802601Z } timeseries_name = switch_table:inserts
1262026-01-13T18:59:01.298ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1272026-01-13T18:59:01.299ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.298777610Z } timeseries_name = switch_table:deletes
1282026-01-13T18:59:01.299ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1292026-01-13T18:59:01.300ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.299772759Z } timeseries_name = switch_table:updates
1302026-01-13T18:59:01.300ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1312026-01-13T18:59:01.301ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.300785159Z } timeseries_name = switch_table:collisions
1322026-01-13T18:59:01.301ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1332026-01-13T18:59:01.302ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.301775549Z } timeseries_name = switch_table:update_misses
1342026-01-13T18:59:01.302ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1352026-01-13T18:59:01.303ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.302758358Z } timeseries_name = switch_table:delete_misses
1362026-01-13T18:59:01.303ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1372026-01-13T18:59:01.304ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.303730377Z } timeseries_name = switch_table:exhaustion
1382026-01-13T18:59:01.315ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1392026-01-13T18:59:01.316ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.315585939Z } timeseries_name = dendrite:sample_collection_duration
1402026-01-13T18:59:01.316ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1412026-01-13T18:59:01.317ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.316846393Z } timeseries_name = sled_data_link:errors_received
1422026-01-13T18:59:01.317ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1432026-01-13T18:59:01.319ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.317858903Z } timeseries_name = sled_data_link:errors_sent
1442026-01-13T18:59:01.319ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1452026-01-13T18:59:01.320ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.319224150Z } timeseries_name = sled_data_link:bytes_received
1462026-01-13T18:59:01.320ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1472026-01-13T18:59:01.321ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.320308581Z } timeseries_name = sled_data_link:packets_received
1482026-01-13T18:59:01.321ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1492026-01-13T18:59:01.322ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.321298701Z } timeseries_name = sled_data_link:bytes_sent
1502026-01-13T18:59:01.322ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1512026-01-13T18:59:01.323ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:01.322305800Z } timeseries_name = sled_data_link:packets_sent
1522026-01-13T18:59:01.345ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
1532026-01-13T18:59:01.421ZDEBGoximeter (clickhouse-client): inserting 37 new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1542026-01-13T18:59:01.442ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 410 table_name = fields_i16
1552026-01-13T18:59:01.444ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 10 table_name = fields_ipaddr
1562026-01-13T18:59:01.448ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 2285 table_name = fields_string
1572026-01-13T18:59:01.450ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 244 table_name = fields_u16
1582026-01-13T18:59:01.452ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 440 table_name = fields_u32
1592026-01-13T18:59:01.454ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 211 table_name = fields_u8
1602026-01-13T18:59:01.456ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 1148 table_name = fields_uuid
1612026-01-13T18:59:01.463ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 6 table_name = measurements_bool
1622026-01-13T18:59:01.468ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 2719 table_name = measurements_cumulativeu64
1632026-01-13T18:59:01.470ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 1 table_name = measurements_f64
1642026-01-13T18:59:01.477ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 29 table_name = measurements_histogramu64
1652026-01-13T18:59:01.479ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 18 table_name = measurements_i64
1662026-01-13T18:59:01.480ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 48 table_name = measurements_u64
1672026-01-13T18:59:01.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1682026-01-13T18:59:01.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1692026-01-13T18:59:01.899ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1702026-01-13T18:59:02.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1712026-01-13T18:59:02.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1722026-01-13T18:59:02.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1732026-01-13T18:59:03.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1742026-01-13T18:59:03.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1752026-01-13T18:59:03.905ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1762026-01-13T18:59:04.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1772026-01-13T18:59:04.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1782026-01-13T18:59:04.899ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1792026-01-13T18:59:05.224ZDEBGoximeter (results-sink-cluster): inserting 56 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
1802026-01-13T18:59:05.224ZDEBGoximeter (results-sink): inserting 56 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
1812026-01-13T18:59:05.224ZDEBGoximeter (clickhouse-client): unrolling 56 total samples collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
1822026-01-13T18:59:05.229ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 26 table_name = fields_string
1832026-01-13T18:59:05.231ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 28 table_name = fields_uuid
1842026-01-13T18:59:05.233ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 40 table_name = measurements_cumulativeu64
1852026-01-13T18:59:05.235ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 16 table_name = measurements_u64
1862026-01-13T18:59:05.325ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
1872026-01-13T18:59:05.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1882026-01-13T18:59:05.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1892026-01-13T18:59:05.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1902026-01-13T18:59:06.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1912026-01-13T18:59:06.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1922026-01-13T18:59:06.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1932026-01-13T18:59:07.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1942026-01-13T18:59:07.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1952026-01-13T18:59:07.901ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1962026-01-13T18:59:08.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1972026-01-13T18:59:08.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1982026-01-13T18:59:08.899ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1992026-01-13T18:59:09.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2002026-01-13T18:59:09.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2012026-01-13T18:59:09.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2022026-01-13T18:59:10.224ZDEBGoximeter (results-sink): inserting 70 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
2032026-01-13T18:59:10.224ZDEBGoximeter (results-sink-cluster): inserting 70 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
2042026-01-13T18:59:10.224ZDEBGoximeter (clickhouse-client): unrolling 70 total samples collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
2052026-01-13T18:59:10.229ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 26 table_name = fields_string
2062026-01-13T18:59:10.231ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 28 table_name = fields_uuid
2072026-01-13T18:59:10.233ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 50 table_name = measurements_cumulativeu64
2082026-01-13T18:59:10.234ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 20 table_name = measurements_u64
2092026-01-13T18:59:10.325ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
2102026-01-13T18:59:10.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8 producer_ip = fd00:1122:3344:101::2 producer_port = 47874
2112026-01-13T18:59:10.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2122026-01-13T18:59:10.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607 producer_ip = fd00:1122:3344:101::a producer_port = 38898
2132026-01-13T18:59:10.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8 producer_ip = fd00:1122:3344:101::2 producer_port = 47874
2142026-01-13T18:59:10.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 1a77ee0d-c128-49c7-810d-60275f214113 producer_ip = fd00:1122:3344:101::2 producer_port = 62302
2152026-01-13T18:59:10.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607 producer_ip = fd00:1122:3344:101::a producer_port = 38898
2162026-01-13T18:59:10.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2172026-01-13T18:59:10.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 1a77ee0d-c128-49c7-810d-60275f214113 producer_ip = fd00:1122:3344:101::2 producer_port = 62302
2182026-01-13T18:59:10.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2192026-01-13T18:59:10.901ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8 producer_ip = fd00:1122:3344:101::2 producer_port = 47874
2202026-01-13T18:59:10.902ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607 producer_ip = fd00:1122:3344:101::a producer_port = 38898
2212026-01-13T18:59:10.916ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1a77ee0d-c128-49c7-810d-60275f214113 producer_ip = fd00:1122:3344:101::2 producer_port = 62302
2222026-01-13T18:59:11.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2232026-01-13T18:59:11.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2242026-01-13T18:59:11.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2252026-01-13T18:59:12.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2262026-01-13T18:59:12.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2272026-01-13T18:59:12.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2282026-01-13T18:59:13.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2292026-01-13T18:59:13.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2302026-01-13T18:59:13.899ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2312026-01-13T18:59:14.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2322026-01-13T18:59:14.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2332026-01-13T18:59:14.901ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2342026-01-13T18:59:15.224ZDEBGoximeter (results-sink): inserting 306 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
2352026-01-13T18:59:15.224ZDEBGoximeter (results-sink-cluster): inserting 306 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
2362026-01-13T18:59:15.224ZDEBGoximeter (clickhouse-client): unrolling 306 total samples collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
2372026-01-13T18:59:15.242ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 410 table_name = fields_i16
2382026-01-13T18:59:15.244ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 1144 table_name = fields_string
2392026-01-13T18:59:15.246ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 236 table_name = fields_u16
2402026-01-13T18:59:15.248ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 212 table_name = fields_u32
2412026-01-13T18:59:15.249ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 211 table_name = fields_u8
2422026-01-13T18:59:15.251ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 674 table_name = fields_uuid
2432026-01-13T18:59:15.253ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 6 table_name = measurements_bool
2442026-01-13T18:59:15.255ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 204 table_name = measurements_cumulativeu64
2452026-01-13T18:59:15.256ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 1 table_name = measurements_f64
2462026-01-13T18:59:15.259ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 31 table_name = measurements_histogramu64
2472026-01-13T18:59:15.260ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 64 table_name = measurements_u64
2482026-01-13T18:59:15.325ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
2492026-01-13T18:59:15.852ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
2502026-01-13T18:59:15.853ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?sort_by=id_ascending
2512026-01-13T18:59:15.870ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "3311ce10-d642-4cc5-b5b0-75f287e54d78", "content-length": "864", "date": "Tue, 13 Jan 2026 18:59:15 GMT"} })
2522026-01-13T18:59:15.870ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWUxNGFmMS0zNTRiLTQyN2EtYjFiNC1iOTU0ZjQ2NTQ2YTYifX0%3D
2532026-01-13T18:59:15.872ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWUxNGFmMS0zNTRiLTQyN2EtYjFiNC1iOTU0ZjQ2NTQ2YTYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "4af8c0d7-60e8-4f26-bcb3-fafda006baa5", "content-length": "29", "date": "Tue, 13 Jan 2026 18:59:15 GMT"} })
2542026-01-13T18:59:15.872ZDEBGoximeter (oximeter-agent): received request to register existing metric producer, updating collection information address = [fd00:1122:3344:101::2]:51411 collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d interval = 30s producer_id = 1a77ee0d-c128-49c7-810d-60275f214113
2552026-01-13T18:59:15.872ZDEBGoximeter (collection-task-handle): notified collection task of new producer endpoint collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 1a77ee0d-c128-49c7-810d-60275f214113 producer_ip = fd00:1122:3344:101::2 producer_port = 62302
2562026-01-13T18:59:15.872ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 5 n_pruned_tasks = 0
2572026-01-13T18:59:15.872ZDEBGoximeter (collection-task): collection task received request to update its producer information address = [fd00:1122:3344:101::2]:51411 collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d interval = 30s producer_id = 1a77ee0d-c128-49c7-810d-60275f214113 producer_ip = fd00:1122:3344:101::2 producer_port = 62302
2582026-01-13T18:59:15.873ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 1a77ee0d-c128-49c7-810d-60275f214113 producer_ip = fd00:1122:3344:101::2 producer_port = 62302
2592026-01-13T18:59:15.873ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 1a77ee0d-c128-49c7-810d-60275f214113 producer_ip = fd00:1122:3344:101::2 producer_port = 62302
2602026-01-13T18:59:15.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2612026-01-13T18:59:15.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2622026-01-13T18:59:15.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2632026-01-13T18:59:15.908ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1a77ee0d-c128-49c7-810d-60275f214113 producer_ip = fd00:1122:3344:101::2 producer_port = 62302
2642026-01-13T18:59:16.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2652026-01-13T18:59:16.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2662026-01-13T18:59:16.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2672026-01-13T18:59:17.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2682026-01-13T18:59:17.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2692026-01-13T18:59:17.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2702026-01-13T18:59:18.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2712026-01-13T18:59:18.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2722026-01-13T18:59:18.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2732026-01-13T18:59:19.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2742026-01-13T18:59:19.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2752026-01-13T18:59:19.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2762026-01-13T18:59:20.224ZDEBGoximeter (results-sink): inserting 394 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
2772026-01-13T18:59:20.224ZDEBGoximeter (results-sink-cluster): inserting 394 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
2782026-01-13T18:59:20.224ZDEBGoximeter (clickhouse-client): unrolling 394 total samples collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
2792026-01-13T18:59:20.225ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
2802026-01-13T18:59:20.248ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:20.225366804Z } timeseries_name = switch_port_control_data_link:errors_received
2812026-01-13T18:59:20.248ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
2822026-01-13T18:59:20.250ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:20.248863454Z } timeseries_name = switch_port_control_data_link:errors_sent
2832026-01-13T18:59:20.250ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
2842026-01-13T18:59:20.252ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:20.250598218Z } timeseries_name = switch_port_control_data_link:bytes_received
2852026-01-13T18:59:20.252ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
2862026-01-13T18:59:20.253ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:20.252133368Z } timeseries_name = switch_port_control_data_link:packets_received
2872026-01-13T18:59:20.253ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
2882026-01-13T18:59:20.255ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:20.253662708Z } timeseries_name = switch_port_control_data_link:bytes_sent
2892026-01-13T18:59:20.255ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
2902026-01-13T18:59:20.256ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:20.255161627Z } timeseries_name = switch_port_control_data_link:packets_sent
2912026-01-13T18:59:20.271ZDEBGoximeter (clickhouse-client): inserting 6 new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
2922026-01-13T18:59:20.274ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 24 table_name = fields_i16
2932026-01-13T18:59:20.275ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 146 table_name = fields_string
2942026-01-13T18:59:20.277ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 12 table_name = fields_u16
2952026-01-13T18:59:20.278ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 24 table_name = fields_u32
2962026-01-13T18:59:20.279ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 12 table_name = fields_u8
2972026-01-13T18:59:20.280ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 64 table_name = fields_uuid
2982026-01-13T18:59:20.282ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 374 table_name = measurements_cumulativeu64
2992026-01-13T18:59:20.283ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 20 table_name = measurements_u64
3002026-01-13T18:59:20.325ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
3012026-01-13T18:59:20.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8 producer_ip = fd00:1122:3344:101::2 producer_port = 47874
3022026-01-13T18:59:20.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8 producer_ip = fd00:1122:3344:101::2 producer_port = 47874
3032026-01-13T18:59:20.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3042026-01-13T18:59:20.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607 producer_ip = fd00:1122:3344:101::a producer_port = 38898
3052026-01-13T18:59:20.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3062026-01-13T18:59:20.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607 producer_ip = fd00:1122:3344:101::a producer_port = 38898
3072026-01-13T18:59:20.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3082026-01-13T18:59:20.901ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8 producer_ip = fd00:1122:3344:101::2 producer_port = 47874
3092026-01-13T18:59:20.902ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607 producer_ip = fd00:1122:3344:101::a producer_port = 38898
3102026-01-13T18:59:21.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3112026-01-13T18:59:21.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3122026-01-13T18:59:21.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3132026-01-13T18:59:22.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3142026-01-13T18:59:22.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3152026-01-13T18:59:22.901ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3162026-01-13T18:59:23.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3172026-01-13T18:59:23.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3182026-01-13T18:59:23.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3192026-01-13T18:59:24.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3202026-01-13T18:59:24.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3212026-01-13T18:59:24.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3222026-01-13T18:59:25.224ZDEBGoximeter (results-sink): inserting 102 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
3232026-01-13T18:59:25.224ZDEBGoximeter (results-sink-cluster): inserting 102 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
3242026-01-13T18:59:25.225ZDEBGoximeter (clickhouse-client): unrolling 102 total samples collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
3252026-01-13T18:59:25.231ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 90 table_name = fields_string
3262026-01-13T18:59:25.233ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 32 table_name = fields_u16
3272026-01-13T18:59:25.234ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 60 table_name = fields_uuid
3282026-01-13T18:59:25.236ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 50 table_name = measurements_cumulativeu64
3292026-01-13T18:59:25.238ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 32 table_name = measurements_histogramu64
3302026-01-13T18:59:25.239ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 20 table_name = measurements_u64
3312026-01-13T18:59:25.325ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
3322026-01-13T18:59:25.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3332026-01-13T18:59:25.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3342026-01-13T18:59:25.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3352026-01-13T18:59:26.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3362026-01-13T18:59:26.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3372026-01-13T18:59:26.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3382026-01-13T18:59:27.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3392026-01-13T18:59:27.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3402026-01-13T18:59:27.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3412026-01-13T18:59:28.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3422026-01-13T18:59:28.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3432026-01-13T18:59:28.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3442026-01-13T18:59:29.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3452026-01-13T18:59:29.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3462026-01-13T18:59:29.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3472026-01-13T18:59:30.224ZDEBGoximeter (results-sink): inserting 70 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
3482026-01-13T18:59:30.224ZDEBGoximeter (results-sink-cluster): inserting 70 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
3492026-01-13T18:59:30.224ZDEBGoximeter (clickhouse-client): unrolling 70 total samples collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
3502026-01-13T18:59:30.229ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 26 table_name = fields_string
3512026-01-13T18:59:30.230ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 28 table_name = fields_uuid
3522026-01-13T18:59:30.232ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 50 table_name = measurements_cumulativeu64
3532026-01-13T18:59:30.234ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 20 table_name = measurements_u64
3542026-01-13T18:59:30.325ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
3552026-01-13T18:59:30.852ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
3562026-01-13T18:59:30.852ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?sort_by=id_ascending
3572026-01-13T18:59:30.857ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "afc5ae32-8bdf-4745-bdb8-dab4504585f7", "content-length": "864", "date": "Tue, 13 Jan 2026 18:59:30 GMT"} })
3582026-01-13T18:59:30.857ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWUxNGFmMS0zNTRiLTQyN2EtYjFiNC1iOTU0ZjQ2NTQ2YTYifX0%3D
3592026-01-13T18:59:30.860ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWUxNGFmMS0zNTRiLTQyN2EtYjFiNC1iOTU0ZjQ2NTQ2YTYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7cadb91-5510-46b9-9f69-93da981b9111", "content-length": "29", "date": "Tue, 13 Jan 2026 18:59:30 GMT"} })
3602026-01-13T18:59:30.860ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 5 n_pruned_tasks = 0
3612026-01-13T18:59:30.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = c9e14af1-354b-427a-b1b4-b954f46546a6 producer_ip = fd00:1122:3344:101::1 producer_port = 57622
3622026-01-13T18:59:30.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8 producer_ip = fd00:1122:3344:101::2 producer_port = 47874
3632026-01-13T18:59:30.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = c9e14af1-354b-427a-b1b4-b954f46546a6 producer_ip = fd00:1122:3344:101::1 producer_port = 57622
3642026-01-13T18:59:30.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3652026-01-13T18:59:30.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607 producer_ip = fd00:1122:3344:101::a producer_port = 38898
3662026-01-13T18:59:30.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607 producer_ip = fd00:1122:3344:101::a producer_port = 38898
3672026-01-13T18:59:30.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3682026-01-13T18:59:30.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8 producer_ip = fd00:1122:3344:101::2 producer_port = 47874
3692026-01-13T18:59:30.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3702026-01-13T18:59:30.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8 producer_ip = fd00:1122:3344:101::2 producer_port = 47874
3712026-01-13T18:59:30.901ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607 producer_ip = fd00:1122:3344:101::a producer_port = 38898
3722026-01-13T18:59:30.928ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = c9e14af1-354b-427a-b1b4-b954f46546a6 producer_ip = fd00:1122:3344:101::1 producer_port = 57622
3732026-01-13T18:59:31.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3742026-01-13T18:59:31.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3752026-01-13T18:59:31.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3762026-01-13T18:59:32.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3772026-01-13T18:59:32.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3782026-01-13T18:59:32.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3792026-01-13T18:59:33.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3802026-01-13T18:59:33.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3812026-01-13T18:59:33.901ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3822026-01-13T18:59:34.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3832026-01-13T18:59:34.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3842026-01-13T18:59:34.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3852026-01-13T18:59:35.224ZDEBGoximeter (results-sink): inserting 780 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
3862026-01-13T18:59:35.224ZDEBGoximeter (results-sink-cluster): inserting 780 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
3872026-01-13T18:59:35.224ZDEBGoximeter (clickhouse-client): unrolling 780 total samples collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
3882026-01-13T18:59:35.277ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 1230 table_name = fields_string
3892026-01-13T18:59:35.279ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 32 table_name = fields_u16
3902026-01-13T18:59:35.281ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 228 table_name = fields_u32
3912026-01-13T18:59:35.283ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 516 table_name = fields_uuid
3922026-01-13T18:59:35.285ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 728 table_name = measurements_cumulativeu64
3932026-01-13T18:59:35.288ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 32 table_name = measurements_histogramu64
3942026-01-13T18:59:35.290ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 20 table_name = measurements_u64
3952026-01-13T18:59:35.326ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
3962026-01-13T18:59:35.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3972026-01-13T18:59:35.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3982026-01-13T18:59:35.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3992026-01-13T18:59:36.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4002026-01-13T18:59:36.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4012026-01-13T18:59:36.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4022026-01-13T18:59:37.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4032026-01-13T18:59:37.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4042026-01-13T18:59:37.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4052026-01-13T18:59:38.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4062026-01-13T18:59:38.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4072026-01-13T18:59:38.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4082026-01-13T18:59:39.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4092026-01-13T18:59:39.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4102026-01-13T18:59:39.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4112026-01-13T18:59:40.224ZDEBGoximeter (results-sink): inserting 70 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
4122026-01-13T18:59:40.224ZDEBGoximeter (results-sink-cluster): inserting 70 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
4132026-01-13T18:59:40.224ZDEBGoximeter (clickhouse-client): unrolling 70 total samples collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
4142026-01-13T18:59:40.229ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 26 table_name = fields_string
4152026-01-13T18:59:40.230ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 28 table_name = fields_uuid
4162026-01-13T18:59:40.231ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 50 table_name = measurements_cumulativeu64
4172026-01-13T18:59:40.233ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 20 table_name = measurements_u64
4182026-01-13T18:59:40.326ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
4192026-01-13T18:59:40.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8 producer_ip = fd00:1122:3344:101::2 producer_port = 47874
4202026-01-13T18:59:40.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8 producer_ip = fd00:1122:3344:101::2 producer_port = 47874
4212026-01-13T18:59:40.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4222026-01-13T18:59:40.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607 producer_ip = fd00:1122:3344:101::a producer_port = 38898
4232026-01-13T18:59:40.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4242026-01-13T18:59:40.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607 producer_ip = fd00:1122:3344:101::a producer_port = 38898
4252026-01-13T18:59:40.901ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4262026-01-13T18:59:40.901ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8 producer_ip = fd00:1122:3344:101::2 producer_port = 47874
4272026-01-13T18:59:40.903ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607 producer_ip = fd00:1122:3344:101::a producer_port = 38898
4282026-01-13T18:59:41.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4292026-01-13T18:59:41.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4302026-01-13T18:59:41.901ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4312026-01-13T18:59:42.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4322026-01-13T18:59:42.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4332026-01-13T18:59:42.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4342026-01-13T18:59:43.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4352026-01-13T18:59:43.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4362026-01-13T18:59:43.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4372026-01-13T18:59:44.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4382026-01-13T18:59:44.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4392026-01-13T18:59:44.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4402026-01-13T18:59:45.224ZDEBGoximeter (results-sink): inserting 103 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
4412026-01-13T18:59:45.224ZDEBGoximeter (results-sink-cluster): inserting 103 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
4422026-01-13T18:59:45.224ZDEBGoximeter (clickhouse-client): unrolling 103 total samples collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
4432026-01-13T18:59:45.230ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 92 table_name = fields_string
4442026-01-13T18:59:45.232ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 33 table_name = fields_u16
4452026-01-13T18:59:45.233ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 61 table_name = fields_uuid
4462026-01-13T18:59:45.235ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 50 table_name = measurements_cumulativeu64
4472026-01-13T18:59:45.237ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 33 table_name = measurements_histogramu64
4482026-01-13T18:59:45.238ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 20 table_name = measurements_u64
4492026-01-13T18:59:45.325ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
4502026-01-13T18:59:45.852ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
4512026-01-13T18:59:45.852ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?sort_by=id_ascending
4522026-01-13T18:59:45.855ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "7308fe0a-7d53-4b82-8202-cd9ca4c88b85", "content-length": "1276", "date": "Tue, 13 Jan 2026 18:59:45 GMT"} })
4532026-01-13T18:59:45.855ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWUxNGFmMS0zNTRiLTQyN2EtYjFiNC1iOTU0ZjQ2NTQ2YTYifX0%3D
4542026-01-13T18:59:45.858ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWUxNGFmMS0zNTRiLTQyN2EtYjFiNC1iOTU0ZjQ2NTQ2YTYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb52923c-fb6f-49fe-8b84-a19729b9ba49", "content-length": "29", "date": "Tue, 13 Jan 2026 18:59:45 GMT"} })
4552026-01-13T18:59:45.858ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355
4562026-01-13T18:59:45.858ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:53615 collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = ae2652af-cb56-407e-90fd-9d58ca2e4cec
4572026-01-13T18:59:45.858ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:41016 collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = c6d554e1-b91d-4573-9d51-8793772573be
4582026-01-13T18:59:45.858ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 8 n_pruned_tasks = 0
4592026-01-13T18:59:45.859ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4602026-01-13T18:59:45.859ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4612026-01-13T18:59:45.859ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = ae2652af-cb56-407e-90fd-9d58ca2e4cec producer_ip = fd00:1122:3344:101::b producer_port = 53615
4622026-01-13T18:59:45.859ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = c6d554e1-b91d-4573-9d51-8793772573be producer_ip = fd00:1122:3344:101::c producer_port = 41016
4632026-01-13T18:59:45.859ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = ae2652af-cb56-407e-90fd-9d58ca2e4cec producer_ip = fd00:1122:3344:101::b producer_port = 53615
4642026-01-13T18:59:45.859ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = c6d554e1-b91d-4573-9d51-8793772573be producer_ip = fd00:1122:3344:101::c producer_port = 41016
4652026-01-13T18:59:45.873ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 1a77ee0d-c128-49c7-810d-60275f214113 producer_ip = fd00:1122:3344:101::2 producer_port = 62302
4662026-01-13T18:59:45.873ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 1a77ee0d-c128-49c7-810d-60275f214113 producer_ip = fd00:1122:3344:101::2 producer_port = 62302
4672026-01-13T18:59:45.876ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1a77ee0d-c128-49c7-810d-60275f214113 producer_ip = fd00:1122:3344:101::2 producer_port = 62302
4682026-01-13T18:59:45.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4692026-01-13T18:59:45.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4702026-01-13T18:59:45.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4712026-01-13T18:59:45.931ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = ae2652af-cb56-407e-90fd-9d58ca2e4cec producer_ip = fd00:1122:3344:101::b producer_port = 53615
4722026-01-13T18:59:45.933ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4732026-01-13T18:59:45.933ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = c6d554e1-b91d-4573-9d51-8793772573be producer_ip = fd00:1122:3344:101::c producer_port = 41016
4742026-01-13T18:59:45.940ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4752026-01-13T18:59:45.940ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = c6d554e1-b91d-4573-9d51-8793772573be producer_ip = fd00:1122:3344:101::c producer_port = 41016
4762026-01-13T18:59:45.942ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = ae2652af-cb56-407e-90fd-9d58ca2e4cec producer_ip = fd00:1122:3344:101::b producer_port = 53615
4772026-01-13T18:59:46.860ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4782026-01-13T18:59:46.860ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4792026-01-13T18:59:46.861ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4802026-01-13T18:59:46.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4812026-01-13T18:59:46.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4822026-01-13T18:59:46.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4832026-01-13T18:59:47.859ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4842026-01-13T18:59:47.859ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4852026-01-13T18:59:47.861ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4862026-01-13T18:59:47.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4872026-01-13T18:59:47.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4882026-01-13T18:59:47.899ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4892026-01-13T18:59:48.860ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4902026-01-13T18:59:48.860ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4912026-01-13T18:59:48.860ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4922026-01-13T18:59:48.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4932026-01-13T18:59:48.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4942026-01-13T18:59:48.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4952026-01-13T18:59:49.859ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4962026-01-13T18:59:49.859ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4972026-01-13T18:59:49.860ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4982026-01-13T18:59:49.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4992026-01-13T18:59:49.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5002026-01-13T18:59:49.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5012026-01-13T18:59:50.224ZDEBGoximeter (results-sink): inserting 147 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
5022026-01-13T18:59:50.224ZDEBGoximeter (results-sink-cluster): inserting 147 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
5032026-01-13T18:59:50.224ZDEBGoximeter (clickhouse-client): unrolling 147 total samples collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
5042026-01-13T18:59:50.227ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
5052026-01-13T18:59:50.232ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:50.227203353Z } timeseries_name = static_routing_config:static_routes
5062026-01-13T18:59:50.232ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
5072026-01-13T18:59:50.234ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:50.232308393Z } timeseries_name = static_routing_config:static_nexthops
5082026-01-13T18:59:50.234ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
5092026-01-13T18:59:50.236ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:50.234433924Z } timeseries_name = switch_rib:active_routes
5102026-01-13T18:59:50.236ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
5112026-01-13T18:59:50.238ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:50.236386813Z } timeseries_name = mg_lower:routes_blocked_by_link_state
5122026-01-13T18:59:50.239ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
5132026-01-13T18:59:50.240ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 schema = TimeseriesSchema { timeseries_name: TimeseriesName("database_transaction:retry_data"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "attempt", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-01-13T18:59:50.239090055Z } timeseries_name = database_transaction:retry_data
5142026-01-13T18:59:50.243ZDEBGoximeter (clickhouse-client): inserting 5 new timeseries schema collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
5152026-01-13T18:59:50.246ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 24 table_name = fields_i16
5162026-01-13T18:59:50.247ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 6 table_name = fields_ipaddr
5172026-01-13T18:59:50.249ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 170 table_name = fields_string
5182026-01-13T18:59:50.250ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 26 table_name = fields_u16
5192026-01-13T18:59:50.252ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 25 table_name = fields_u32
5202026-01-13T18:59:50.253ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 12 table_name = fields_u8
5212026-01-13T18:59:50.254ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 95 table_name = fields_uuid
5222026-01-13T18:59:50.256ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 99 table_name = measurements_cumulativeu64
5232026-01-13T18:59:50.257ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 1 table_name = measurements_f64
5242026-01-13T18:59:50.259ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 8 table_name = measurements_histogramu64
5252026-01-13T18:59:50.260ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 9 table_name = measurements_i64
5262026-01-13T18:59:50.262ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 30 table_name = measurements_u64
5272026-01-13T18:59:50.326ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
5282026-01-13T18:59:50.860ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5292026-01-13T18:59:50.860ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5302026-01-13T18:59:50.861ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5312026-01-13T18:59:50.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8 producer_ip = fd00:1122:3344:101::2 producer_port = 47874
5322026-01-13T18:59:50.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8 producer_ip = fd00:1122:3344:101::2 producer_port = 47874
5332026-01-13T18:59:50.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5342026-01-13T18:59:50.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607 producer_ip = fd00:1122:3344:101::a producer_port = 38898
5352026-01-13T18:59:50.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607 producer_ip = fd00:1122:3344:101::a producer_port = 38898
5362026-01-13T18:59:50.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5372026-01-13T18:59:50.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5382026-01-13T18:59:50.901ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8 producer_ip = fd00:1122:3344:101::2 producer_port = 47874
5392026-01-13T18:59:50.902ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607 producer_ip = fd00:1122:3344:101::a producer_port = 38898
5402026-01-13T18:59:51.860ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5412026-01-13T18:59:51.860ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5422026-01-13T18:59:51.861ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5432026-01-13T18:59:51.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5442026-01-13T18:59:51.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5452026-01-13T18:59:51.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5462026-01-13T18:59:52.860ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5472026-01-13T18:59:52.860ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5482026-01-13T18:59:52.861ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5492026-01-13T18:59:52.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5502026-01-13T18:59:52.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5512026-01-13T18:59:52.901ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5522026-01-13T18:59:53.859ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5532026-01-13T18:59:53.859ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5542026-01-13T18:59:53.860ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5552026-01-13T18:59:53.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5562026-01-13T18:59:53.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5572026-01-13T18:59:53.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5582026-01-13T18:59:54.860ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5592026-01-13T18:59:54.860ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5602026-01-13T18:59:54.861ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5612026-01-13T18:59:54.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5622026-01-13T18:59:54.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5632026-01-13T18:59:54.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5642026-01-13T18:59:55.224ZDEBGoximeter (results-sink): inserting 123 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
5652026-01-13T18:59:55.224ZDEBGoximeter (results-sink-cluster): inserting 123 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
5662026-01-13T18:59:55.224ZDEBGoximeter (clickhouse-client): unrolling 123 total samples collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
5672026-01-13T18:59:55.232ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 96 table_name = fields_string
5682026-01-13T18:59:55.233ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 33 table_name = fields_u16
5692026-01-13T18:59:55.235ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 69 table_name = fields_uuid
5702026-01-13T18:59:55.236ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 60 table_name = measurements_cumulativeu64
5712026-01-13T18:59:55.238ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 33 table_name = measurements_histogramu64
5722026-01-13T18:59:55.239ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 30 table_name = measurements_u64
5732026-01-13T18:59:55.325ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
5742026-01-13T18:59:55.860ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = ae2652af-cb56-407e-90fd-9d58ca2e4cec producer_ip = fd00:1122:3344:101::b producer_port = 53615
5752026-01-13T18:59:55.860ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = ae2652af-cb56-407e-90fd-9d58ca2e4cec producer_ip = fd00:1122:3344:101::b producer_port = 53615
5762026-01-13T18:59:55.860ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5772026-01-13T18:59:55.860ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5782026-01-13T18:59:55.860ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = c6d554e1-b91d-4573-9d51-8793772573be producer_ip = fd00:1122:3344:101::c producer_port = 41016
5792026-01-13T18:59:55.860ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = c6d554e1-b91d-4573-9d51-8793772573be producer_ip = fd00:1122:3344:101::c producer_port = 41016
5802026-01-13T18:59:55.861ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5812026-01-13T18:59:55.861ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = c6d554e1-b91d-4573-9d51-8793772573be producer_ip = fd00:1122:3344:101::c producer_port = 41016
5822026-01-13T18:59:55.861ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = ae2652af-cb56-407e-90fd-9d58ca2e4cec producer_ip = fd00:1122:3344:101::b producer_port = 53615
5832026-01-13T18:59:55.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5842026-01-13T18:59:55.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5852026-01-13T18:59:55.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5862026-01-13T18:59:56.860ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5872026-01-13T18:59:56.860ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5882026-01-13T18:59:56.861ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5892026-01-13T18:59:56.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5902026-01-13T18:59:56.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5912026-01-13T18:59:56.901ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5922026-01-13T18:59:57.859ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5932026-01-13T18:59:57.859ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5942026-01-13T18:59:57.860ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5952026-01-13T18:59:57.898ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5962026-01-13T18:59:57.898ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5972026-01-13T18:59:57.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5982026-01-13T18:59:58.860ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5992026-01-13T18:59:58.860ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6002026-01-13T18:59:58.861ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6012026-01-13T18:59:58.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6022026-01-13T18:59:58.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6032026-01-13T18:59:58.901ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6042026-01-13T18:59:59.860ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6052026-01-13T18:59:59.860ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6062026-01-13T18:59:59.861ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6072026-01-13T18:59:59.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6082026-01-13T18:59:59.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6092026-01-13T18:59:59.900ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6102026-01-13T19:00:00.224ZDEBGoximeter (results-sink): inserting 98 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
6112026-01-13T19:00:00.224ZDEBGoximeter (results-sink-cluster): inserting 98 samples into database collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d
6122026-01-13T19:00:00.224ZDEBGoximeter (clickhouse-client): unrolling 98 total samples collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388
6132026-01-13T19:00:00.231ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 46 table_name = fields_string
6142026-01-13T19:00:00.232ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 8 table_name = fields_u16
6152026-01-13T19:00:00.234ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 44 table_name = fields_uuid
6162026-01-13T19:00:00.236ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 60 table_name = measurements_cumulativeu64
6172026-01-13T19:00:00.238ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 8 table_name = measurements_histogramu64
6182026-01-13T19:00:00.239ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d id = 32ba4532-f1dd-4584-9836-8732d4169388 n_rows = 30 table_name = measurements_u64
6192026-01-13T19:00:00.326ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
6202026-01-13T19:00:00.852ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
6212026-01-13T19:00:00.852ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?sort_by=id_ascending
6222026-01-13T19:00:00.856ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "6613def4-047a-4821-a524-5e1da20961d5", "content-length": "1412", "date": "Tue, 13 Jan 2026 19:00:00 GMT"} })
6232026-01-13T19:00:00.856ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWUxNGFmMS0zNTRiLTQyN2EtYjFiNC1iOTU0ZjQ2NTQ2YTYifX0%3D
6242026-01-13T19:00:00.859ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6252026-01-13T19:00:00.859ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6262026-01-13T19:00:00.860ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/af91049d-e328-4563-b7c4-21e2beaa6862/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjOWUxNGFmMS0zNTRiLTQyN2EtYjFiNC1iOTU0ZjQ2NTQ2YTYifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a2ff8a3-2ca6-46c0-ba20-d5bba46eeeda", "content-length": "29", "date": "Tue, 13 Jan 2026 19:00:00 GMT"} })
6272026-01-13T19:00:00.860ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 5da6274a-5e89-4caa-8896-8ed3eacf30bb
6282026-01-13T19:00:00.860ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 9 n_pruned_tasks = 0
6292026-01-13T19:00:00.860ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 5da6274a-5e89-4caa-8896-8ed3eacf30bb producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6302026-01-13T19:00:00.860ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 5da6274a-5e89-4caa-8896-8ed3eacf30bb producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6312026-01-13T19:00:00.860ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 68c7f1c3-207d-46a4-bebc-bb9d63f0d355 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6322026-01-13T19:00:00.893ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 5da6274a-5e89-4caa-8896-8ed3eacf30bb producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6332026-01-13T19:00:00.899ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6342026-01-13T19:00:00.899ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 1a77ee0d-c128-49c7-810d-60275f214113 producer_ip = fd00:1122:3344:101::2 producer_port = 62302
6352026-01-13T19:00:00.899ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8 producer_ip = fd00:1122:3344:101::2 producer_port = 47874
6362026-01-13T19:00:00.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = c9e14af1-354b-427a-b1b4-b954f46546a6 producer_ip = fd00:1122:3344:101::1 producer_port = 57622
6372026-01-13T19:00:00.899ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = c9e14af1-354b-427a-b1b4-b954f46546a6 producer_ip = fd00:1122:3344:101::1 producer_port = 57622
6382026-01-13T19:00:00.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = c9e14af1-354b-427a-b1b4-b954f46546a6 producer_ip = fd00:1122:3344:101::1 producer_port = 57622
6392026-01-13T19:00:00.899ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607 producer_ip = fd00:1122:3344:101::a producer_port = 38898
6402026-01-13T19:00:00.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6412026-01-13T19:00:00.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6422026-01-13T19:00:00.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607 producer_ip = fd00:1122:3344:101::a producer_port = 38898
6432026-01-13T19:00:00.899ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8 producer_ip = fd00:1122:3344:101::2 producer_port = 47874
6442026-01-13T19:00:00.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607 producer_ip = fd00:1122:3344:101::a producer_port = 38898
6452026-01-13T19:00:00.899ZDEBGoximeter (collection-task): collecting from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8 producer_ip = fd00:1122:3344:101::2 producer_port = 47874
6462026-01-13T19:00:00.901ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7ca6f0ac-3242-439a-a8b6-48fc0731ab86 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6472026-01-13T19:00:00.901ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 50cee296-c0a1-4335-a2a5-65aef9d506a8 producer_ip = fd00:1122:3344:101::2 producer_port = 47874
6482026-01-13T19:00:00.903ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 194f07be-a0ae-4844-88f8-c8e2e650b607 producer_ip = fd00:1122:3344:101::a producer_port = 38898
6492026-01-13T19:00:00.903ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5da6274a-5e89-4caa-8896-8ed3eacf30bb producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6502026-01-13T19:00:00.933ZDEBGoximeter (collection-task): collected results from producer collector_id = af91049d-e328-4563-b7c4-21e2beaa6862 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = c9e14af1-354b-427a-b1b4-b954f46546a6 producer_ip = fd00:1122:3344:101::1 producer_port = 57622