Max level shown:
1 [ Mar 18 23:13:34 Enabled. ]
2 [ Mar 18 23:13:34 Rereading configuration. ]
3 [ Mar 18 23:13:35 Rereading configuration. ]
4 [ Mar 18 23:13:43 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id dd380624-e9b2-4c50-8300-64bae2e9a5ad &"). ]
5 [ Mar 18 23:13:43 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-03-18T23:13:44.100ZDEBGoximeter: registered DTrace probes
82026-03-18T23:13:44.103ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:265
92026-03-18T23:13:44.105ZDEBGoximeter: creating ClickHouse client
102026-03-18T23:13:44.183ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
112026-03-18T23:14:00.867ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:900 id = 8745619e-fb68-4493-ab54-166ae26a65db
122026-03-18T23:14:00.867ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d
132026-03-18T23:14:00.867ZINFOoximeter (clickhouse-client): reading db version collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:800 id = 8745619e-fb68-4493-ab54-166ae26a65db
142026-03-18T23:14:00.870ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:900 id = 8745619e-fb68-4493-ab54-166ae26a65db
152026-03-18T23:14:00.870ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:805 id = 8745619e-fb68-4493-ab54-166ae26a65db version = 0
162026-03-18T23:14:00.870ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:810 id = 8745619e-fb68-4493-ab54-166ae26a65db
172026-03-18T23:14:00.870ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
182026-03-18T23:14:01.141ZINFOoximeter (clickhouse-client): inserting current version collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:831 id = 8745619e-fb68-4493-ab54-166ae26a65db version = 14
192026-03-18T23:14:01.217ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 7f98224e-036b-48d1-a3db-9fb0bdbaf2bf
202026-03-18T23:14:01.262ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-03-18T23:14:01.262ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-03-18T23:14:01.265ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-03-18T23:14:01.265ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-03-18T23:14:01.265ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::d]:12223
252026-03-18T23:14:01.275ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-03-18T23:14:01.277ZDEBGoximeter: registered USDT probes
272026-03-18T23:14:01.277ZDEBGoximeter: contacting nexus
282026-03-18T23:14:01.346ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
292026-03-18T23:14:01.371ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "8dfb0ad9-f0c1-4a38-b533-9ca468378f56", "date": "Wed, 18 Mar 2026 23:14:01 GMT"} })
302026-03-18T23:14:01.373ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:428 id = dd380624-e9b2-4c50-8300-64bae2e9a5ad
312026-03-18T23:14:01.373ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:554
322026-03-18T23:14:01.374ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
332026-03-18T23:14:01.375ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/dd380624-e9b2-4c50-8300-64bae2e9a5ad/producers?sort_by=id_ascending
342026-03-18T23:14:01.407ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/dd380624-e9b2-4c50-8300-64bae2e9a5ad/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6a2afd7-b681-41b2-a597-f1bf6f6ad5e7", "content-length": "29", "date": "Wed, 18 Mar 2026 23:14:01 GMT"} })
352026-03-18T23:14:01.407ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 0 n_pruned_tasks = 0
362026-03-18T23:14:16.374ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
372026-03-18T23:14:16.374ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/dd380624-e9b2-4c50-8300-64bae2e9a5ad/producers?sort_by=id_ascending
382026-03-18T23:14:16.387ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/dd380624-e9b2-4c50-8300-64bae2e9a5ad/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "37f6d708-a1af-4931-8e02-416e9906b0a6", "content-length": "859", "date": "Wed, 18 Mar 2026 23:14:16 GMT"} })
392026-03-18T23:14:16.390ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/dd380624-e9b2-4c50-8300-64bae2e9a5ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZjhhM2Q1Yi1mMzRjLTRhZjQtOGJjOS02NzhmYjg1NmFmOGMifX0%3D
402026-03-18T23:14:16.393ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/dd380624-e9b2-4c50-8300-64bae2e9a5ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZjhhM2Q1Yi1mMzRjLTRhZjQtOGJjOS02NzhmYjg1NmFmOGMifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "6497e155-8792-4573-8d78-e5aa20892c48", "content-length": "29", "date": "Wed, 18 Mar 2026 23:14:16 GMT"} })
412026-03-18T23:14:16.393ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:35411 collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 169680fd-400d-4d9a-8dd1-1eab246fac7b
422026-03-18T23:14:16.393ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13
432026-03-18T23:14:16.393ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:51303 collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 6255051b-ca86-401d-9418-d4c725318530
442026-03-18T23:14:16.393ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:61088 collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 8c76a14a-af59-415c-a84d-6b642a24a417
452026-03-18T23:14:16.393ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c
462026-03-18T23:14:16.393ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 5 n_pruned_tasks = 0
472026-03-18T23:14:16.394ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 169680fd-400d-4d9a-8dd1-1eab246fac7b producer_ip = fd00:1122:3344:101::a producer_port = 35411
482026-03-18T23:14:16.394ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 6255051b-ca86-401d-9418-d4c725318530 producer_ip = fd00:1122:3344:101::2 producer_port = 51303
492026-03-18T23:14:16.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
502026-03-18T23:14:16.394ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
512026-03-18T23:14:16.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 8c76a14a-af59-415c-a84d-6b642a24a417 producer_ip = fd00:1122:3344:101::2 producer_port = 61088
522026-03-18T23:14:16.394ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 8c76a14a-af59-415c-a84d-6b642a24a417 producer_ip = fd00:1122:3344:101::2 producer_port = 61088
532026-03-18T23:14:16.394ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
542026-03-18T23:14:16.413ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
552026-03-18T23:14:16.416ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 8c76a14a-af59-415c-a84d-6b642a24a417 producer_ip = fd00:1122:3344:101::2 producer_port = 61088
562026-03-18T23:14:16.426ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 6255051b-ca86-401d-9418-d4c725318530 producer_ip = fd00:1122:3344:101::2 producer_port = 51303
572026-03-18T23:14:16.427ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
582026-03-18T23:14:16.427ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 169680fd-400d-4d9a-8dd1-1eab246fac7b producer_ip = fd00:1122:3344:101::a producer_port = 35411
592026-03-18T23:14:16.427ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
602026-03-18T23:14:16.427ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 6255051b-ca86-401d-9418-d4c725318530 producer_ip = fd00:1122:3344:101::2 producer_port = 51303
612026-03-18T23:14:16.427ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 169680fd-400d-4d9a-8dd1-1eab246fac7b producer_ip = fd00:1122:3344:101::a producer_port = 35411
622026-03-18T23:14:16.433ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
632026-03-18T23:14:16.434ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
642026-03-18T23:14:16.440ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 6255051b-ca86-401d-9418-d4c725318530 producer_ip = fd00:1122:3344:101::2 producer_port = 51303
652026-03-18T23:14:16.441ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 169680fd-400d-4d9a-8dd1-1eab246fac7b producer_ip = fd00:1122:3344:101::a producer_port = 35411
662026-03-18T23:14:16.449ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8c76a14a-af59-415c-a84d-6b642a24a417 producer_ip = fd00:1122:3344:101::2 producer_port = 61088
672026-03-18T23:14:17.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
682026-03-18T23:14:17.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
692026-03-18T23:14:17.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
702026-03-18T23:14:17.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
712026-03-18T23:14:17.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
722026-03-18T23:14:17.397ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
732026-03-18T23:14:18.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
742026-03-18T23:14:18.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
752026-03-18T23:14:18.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
762026-03-18T23:14:18.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
772026-03-18T23:14:18.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
782026-03-18T23:14:18.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
792026-03-18T23:14:19.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
802026-03-18T23:14:19.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
812026-03-18T23:14:19.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
822026-03-18T23:14:19.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
832026-03-18T23:14:19.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
842026-03-18T23:14:19.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
852026-03-18T23:14:20.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
862026-03-18T23:14:20.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
872026-03-18T23:14:20.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
882026-03-18T23:14:20.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
892026-03-18T23:14:20.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
902026-03-18T23:14:20.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
912026-03-18T23:14:21.222ZDEBGoximeter (results-sink-cluster): inserting 340 samples into database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d
922026-03-18T23:14:21.222ZDEBGoximeter (results-sink): inserting 340 samples into database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d
932026-03-18T23:14:21.222ZDEBGoximeter (clickhouse-client): unrolling 340 total samples collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
942026-03-18T23:14:21.222ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
952026-03-18T23:14:21.229ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.222916346Z } timeseries_name = oximeter_collector:collections
962026-03-18T23:14:21.244ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
972026-03-18T23:14:21.261ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.244795421Z } timeseries_name = static_routing_config:static_routes
982026-03-18T23:14:21.261ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
992026-03-18T23:14:21.264ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.261535344Z } timeseries_name = static_routing_config:static_nexthops
1002026-03-18T23:14:21.264ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1012026-03-18T23:14:21.265ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.264799598Z } timeseries_name = switch_rib:active_routes
1022026-03-18T23:14:21.265ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1032026-03-18T23:14:21.266ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.265690172Z } timeseries_name = mg_lower:routes_blocked_by_link_state
1042026-03-18T23:14:21.266ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1052026-03-18T23:14:21.267ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.266566834Z } timeseries_name = ddm_router:originated_underlay_prefixes
1062026-03-18T23:14:21.267ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1072026-03-18T23:14:21.268ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.267462187Z } timeseries_name = ddm_router:originated_tunnel_endpoints
1082026-03-18T23:14:21.268ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1092026-03-18T23:14:21.269ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.268348010Z } timeseries_name = ddm_session:solicitations_sent
1102026-03-18T23:14:21.269ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1112026-03-18T23:14:21.269ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.269197792Z } timeseries_name = ddm_session:solicitations_received
1122026-03-18T23:14:21.270ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1132026-03-18T23:14:21.270ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.270063674Z } timeseries_name = ddm_session:advertisements_sent
1142026-03-18T23:14:21.270ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1152026-03-18T23:14:21.271ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.270924607Z } timeseries_name = ddm_session:advertisements_received
1162026-03-18T23:14:21.271ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1172026-03-18T23:14:21.272ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.271787969Z } timeseries_name = ddm_session:peer_expirations
1182026-03-18T23:14:21.272ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1192026-03-18T23:14:21.273ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.272661321Z } timeseries_name = ddm_session:peer_address_changes
1202026-03-18T23:14:21.273ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1212026-03-18T23:14:21.274ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.273517094Z } timeseries_name = ddm_session:peer_sessions_established
1222026-03-18T23:14:21.274ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1232026-03-18T23:14:21.275ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.274380636Z } timeseries_name = ddm_session:updates_sent
1242026-03-18T23:14:21.275ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1252026-03-18T23:14:21.276ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.275249808Z } timeseries_name = ddm_session:updates_received
1262026-03-18T23:14:21.276ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1272026-03-18T23:14:21.276ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.276121961Z } timeseries_name = ddm_session:update_send_fail
1282026-03-18T23:14:21.277ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1292026-03-18T23:14:21.277ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.276999864Z } timeseries_name = ddm_session:imported_underlay_prefixes
1302026-03-18T23:14:21.277ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1312026-03-18T23:14:21.278ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.277922208Z } timeseries_name = ddm_session:imported_tunnel_endpoints
1322026-03-18T23:14:21.279ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1332026-03-18T23:14:21.280ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.279219751Z } timeseries_name = http_service:request_latency_histogram
1342026-03-18T23:14:21.281ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1352026-03-18T23:14:21.282ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.281343296Z } timeseries_name = collection_target:cpus_provisioned
1362026-03-18T23:14:21.282ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1372026-03-18T23:14:21.283ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.282256149Z } timeseries_name = collection_target:ram_provisioned
1382026-03-18T23:14:21.283ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1392026-03-18T23:14:21.284ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.283167483Z } timeseries_name = collection_target:virtual_disk_space_provisioned
1402026-03-18T23:14:21.284ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1412026-03-18T23:14:21.285ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.284598120Z } timeseries_name = switch_data_link:link_enabled
1422026-03-18T23:14:21.287ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1432026-03-18T23:14:21.288ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.287773052Z } timeseries_name = switch_data_link:link_up
1442026-03-18T23:14:21.289ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1452026-03-18T23:14:21.289ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.289001744Z } timeseries_name = switch_table:capacity
1462026-03-18T23:14:21.289ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1472026-03-18T23:14:21.290ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.289956159Z } timeseries_name = switch_table:occupancy
1482026-03-18T23:14:21.290ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1492026-03-18T23:14:21.291ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.290907453Z } timeseries_name = switch_table:inserts
1502026-03-18T23:14:21.291ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1512026-03-18T23:14:21.292ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.291858058Z } timeseries_name = switch_table:deletes
1522026-03-18T23:14:21.292ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1532026-03-18T23:14:21.293ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.292819142Z } timeseries_name = switch_table:updates
1542026-03-18T23:14:21.293ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1552026-03-18T23:14:21.294ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.293807818Z } timeseries_name = switch_table:collisions
1562026-03-18T23:14:21.294ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1572026-03-18T23:14:21.295ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.294783213Z } timeseries_name = switch_table:update_misses
1582026-03-18T23:14:21.295ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1592026-03-18T23:14:21.296ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.295766559Z } timeseries_name = switch_table:delete_misses
1602026-03-18T23:14:21.296ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1612026-03-18T23:14:21.297ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.296773045Z } timeseries_name = switch_table:exhaustion
1622026-03-18T23:14:21.304ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1632026-03-18T23:14:21.306ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:21.304979357Z } timeseries_name = dendrite:sample_collection_duration
1642026-03-18T23:14:21.310ZDEBGoximeter (clickhouse-client): inserting 35 new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
1652026-03-18T23:14:21.324ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 284 table_name = fields_i16
1662026-03-18T23:14:21.325ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
1672026-03-18T23:14:21.326ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 10 table_name = fields_ipaddr
1682026-03-18T23:14:21.328ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 826 table_name = fields_string
1692026-03-18T23:14:21.329ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 177 table_name = fields_u16
1702026-03-18T23:14:21.330ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 149 table_name = fields_u32
1712026-03-18T23:14:21.332ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 148 table_name = fields_u8
1722026-03-18T23:14:21.333ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 509 table_name = fields_uuid
1732026-03-18T23:14:21.337ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 6 table_name = measurements_bool
1742026-03-18T23:14:21.339ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 220 table_name = measurements_cumulativeu64
1752026-03-18T23:14:21.340ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 1 table_name = measurements_f64
1762026-03-18T23:14:21.345ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 25 table_name = measurements_histogramu64
1772026-03-18T23:14:21.346ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 18 table_name = measurements_i64
1782026-03-18T23:14:21.348ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 70 table_name = measurements_u64
1792026-03-18T23:14:21.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1802026-03-18T23:14:21.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1812026-03-18T23:14:21.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1822026-03-18T23:14:21.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1832026-03-18T23:14:21.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1842026-03-18T23:14:21.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1852026-03-18T23:14:22.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1862026-03-18T23:14:22.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1872026-03-18T23:14:22.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1882026-03-18T23:14:22.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1892026-03-18T23:14:22.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1902026-03-18T23:14:22.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1912026-03-18T23:14:23.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1922026-03-18T23:14:23.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1932026-03-18T23:14:23.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1942026-03-18T23:14:23.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1952026-03-18T23:14:23.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1962026-03-18T23:14:23.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1972026-03-18T23:14:24.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1982026-03-18T23:14:24.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1992026-03-18T23:14:24.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2002026-03-18T23:14:24.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2012026-03-18T23:14:24.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2022026-03-18T23:14:24.397ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2032026-03-18T23:14:25.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2042026-03-18T23:14:25.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2052026-03-18T23:14:25.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2062026-03-18T23:14:25.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2072026-03-18T23:14:25.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2082026-03-18T23:14:25.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2092026-03-18T23:14:26.221ZDEBGoximeter (results-sink-cluster): inserting 150 samples into database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d
2102026-03-18T23:14:26.221ZDEBGoximeter (results-sink): inserting 150 samples into database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d
2112026-03-18T23:14:26.221ZDEBGoximeter (clickhouse-client): unrolling 150 total samples collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
2122026-03-18T23:14:26.229ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 30 table_name = fields_string
2132026-03-18T23:14:26.231ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 36 table_name = fields_uuid
2142026-03-18T23:14:26.232ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 110 table_name = measurements_cumulativeu64
2152026-03-18T23:14:26.233ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 40 table_name = measurements_u64
2162026-03-18T23:14:26.323ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
2172026-03-18T23:14:26.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 8c76a14a-af59-415c-a84d-6b642a24a417 producer_ip = fd00:1122:3344:101::2 producer_port = 61088
2182026-03-18T23:14:26.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2192026-03-18T23:14:26.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2202026-03-18T23:14:26.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 8c76a14a-af59-415c-a84d-6b642a24a417 producer_ip = fd00:1122:3344:101::2 producer_port = 61088
2212026-03-18T23:14:26.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 6255051b-ca86-401d-9418-d4c725318530 producer_ip = fd00:1122:3344:101::2 producer_port = 51303
2222026-03-18T23:14:26.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 169680fd-400d-4d9a-8dd1-1eab246fac7b producer_ip = fd00:1122:3344:101::a producer_port = 35411
2232026-03-18T23:14:26.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2242026-03-18T23:14:26.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2252026-03-18T23:14:26.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 6255051b-ca86-401d-9418-d4c725318530 producer_ip = fd00:1122:3344:101::2 producer_port = 51303
2262026-03-18T23:14:26.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 169680fd-400d-4d9a-8dd1-1eab246fac7b producer_ip = fd00:1122:3344:101::a producer_port = 35411
2272026-03-18T23:14:26.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2282026-03-18T23:14:26.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 6255051b-ca86-401d-9418-d4c725318530 producer_ip = fd00:1122:3344:101::2 producer_port = 51303
2292026-03-18T23:14:26.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2302026-03-18T23:14:26.399ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 169680fd-400d-4d9a-8dd1-1eab246fac7b producer_ip = fd00:1122:3344:101::a producer_port = 35411
2312026-03-18T23:14:26.406ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8c76a14a-af59-415c-a84d-6b642a24a417 producer_ip = fd00:1122:3344:101::2 producer_port = 61088
2322026-03-18T23:14:27.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2332026-03-18T23:14:27.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2342026-03-18T23:14:27.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2352026-03-18T23:14:27.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2362026-03-18T23:14:27.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2372026-03-18T23:14:27.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2382026-03-18T23:14:28.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2392026-03-18T23:14:28.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2402026-03-18T23:14:28.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2412026-03-18T23:14:28.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2422026-03-18T23:14:28.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2432026-03-18T23:14:28.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2442026-03-18T23:14:29.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2452026-03-18T23:14:29.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2462026-03-18T23:14:29.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2472026-03-18T23:14:29.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2482026-03-18T23:14:29.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2492026-03-18T23:14:29.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2502026-03-18T23:14:30.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2512026-03-18T23:14:30.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2522026-03-18T23:14:30.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2532026-03-18T23:14:30.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2542026-03-18T23:14:30.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2552026-03-18T23:14:30.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2562026-03-18T23:14:31.221ZDEBGoximeter (results-sink): inserting 335 samples into database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d
2572026-03-18T23:14:31.221ZDEBGoximeter (results-sink-cluster): inserting 335 samples into database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d
2582026-03-18T23:14:31.221ZDEBGoximeter (clickhouse-client): unrolling 335 total samples collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
2592026-03-18T23:14:31.239ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 284 table_name = fields_i16
2602026-03-18T23:14:31.241ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 845 table_name = fields_string
2612026-03-18T23:14:31.242ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 179 table_name = fields_u16
2622026-03-18T23:14:31.244ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 149 table_name = fields_u32
2632026-03-18T23:14:31.245ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 148 table_name = fields_u8
2642026-03-18T23:14:31.247ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 504 table_name = fields_uuid
2652026-03-18T23:14:31.248ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 6 table_name = measurements_bool
2662026-03-18T23:14:31.249ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 215 table_name = measurements_cumulativeu64
2672026-03-18T23:14:31.251ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 1 table_name = measurements_f64
2682026-03-18T23:14:31.253ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 37 table_name = measurements_histogramu64
2692026-03-18T23:14:31.254ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 6 table_name = measurements_i64
2702026-03-18T23:14:31.255ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 70 table_name = measurements_u64
2712026-03-18T23:14:31.322ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
2722026-03-18T23:14:31.374ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
2732026-03-18T23:14:31.374ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/dd380624-e9b2-4c50-8300-64bae2e9a5ad/producers?sort_by=id_ascending
2742026-03-18T23:14:31.377ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/dd380624-e9b2-4c50-8300-64bae2e9a5ad/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c315956-254a-49d1-a3a0-fece8c3df09e", "content-length": "859", "date": "Wed, 18 Mar 2026 23:14:31 GMT"} })
2752026-03-18T23:14:31.377ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/dd380624-e9b2-4c50-8300-64bae2e9a5ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZjhhM2Q1Yi1mMzRjLTRhZjQtOGJjOS02NzhmYjg1NmFmOGMifX0%3D
2762026-03-18T23:14:31.379ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/dd380624-e9b2-4c50-8300-64bae2e9a5ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZjhhM2Q1Yi1mMzRjLTRhZjQtOGJjOS02NzhmYjg1NmFmOGMifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "e068731c-1fe0-48e0-bfac-5cf0b49168f3", "content-length": "29", "date": "Wed, 18 Mar 2026 23:14:31 GMT"} })
2772026-03-18T23:14:31.380ZDEBGoximeter (oximeter-agent): received request to register existing metric producer, updating collection information address = [fd00:1122:3344:101::2]:42937 collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d interval = 30s producer_id = 8c76a14a-af59-415c-a84d-6b642a24a417
2782026-03-18T23:14:31.380ZDEBGoximeter (collection-task-handle): notified collection task of new producer endpoint collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 8c76a14a-af59-415c-a84d-6b642a24a417 producer_ip = fd00:1122:3344:101::2 producer_port = 61088
2792026-03-18T23:14:31.380ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 5 n_pruned_tasks = 0
2802026-03-18T23:14:31.380ZDEBGoximeter (collection-task): collection task received request to update its producer information address = [fd00:1122:3344:101::2]:42937 collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d interval = 30s producer_id = 8c76a14a-af59-415c-a84d-6b642a24a417 producer_ip = fd00:1122:3344:101::2 producer_port = 61088
2812026-03-18T23:14:31.381ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 8c76a14a-af59-415c-a84d-6b642a24a417 producer_ip = fd00:1122:3344:101::2 producer_port = 61088
2822026-03-18T23:14:31.381ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 8c76a14a-af59-415c-a84d-6b642a24a417 producer_ip = fd00:1122:3344:101::2 producer_port = 61088
2832026-03-18T23:14:31.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2842026-03-18T23:14:31.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2852026-03-18T23:14:31.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2862026-03-18T23:14:31.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2872026-03-18T23:14:31.394ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2882026-03-18T23:14:31.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2892026-03-18T23:14:31.403ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8c76a14a-af59-415c-a84d-6b642a24a417 producer_ip = fd00:1122:3344:101::2 producer_port = 61088
2902026-03-18T23:14:32.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2912026-03-18T23:14:32.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2922026-03-18T23:14:32.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2932026-03-18T23:14:32.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2942026-03-18T23:14:32.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2952026-03-18T23:14:32.397ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2962026-03-18T23:14:33.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2972026-03-18T23:14:33.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2982026-03-18T23:14:33.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2992026-03-18T23:14:33.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3002026-03-18T23:14:33.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3012026-03-18T23:14:33.397ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3022026-03-18T23:14:34.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3032026-03-18T23:14:34.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3042026-03-18T23:14:34.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3052026-03-18T23:14:34.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3062026-03-18T23:14:34.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3072026-03-18T23:14:34.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3082026-03-18T23:14:35.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3092026-03-18T23:14:35.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3102026-03-18T23:14:35.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3112026-03-18T23:14:35.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3122026-03-18T23:14:35.394ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3132026-03-18T23:14:35.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3142026-03-18T23:14:36.222ZDEBGoximeter (results-sink): inserting 354 samples into database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d
3152026-03-18T23:14:36.222ZDEBGoximeter (results-sink-cluster): inserting 354 samples into database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d
3162026-03-18T23:14:36.222ZDEBGoximeter (clickhouse-client): unrolling 354 total samples collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
3172026-03-18T23:14:36.223ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
3182026-03-18T23:14:36.260ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:36.223905470Z } timeseries_name = switch_port_control_data_link:errors_received
3192026-03-18T23:14:36.261ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
3202026-03-18T23:14:36.262ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:36.261145152Z } timeseries_name = switch_port_control_data_link:errors_sent
3212026-03-18T23:14:36.263ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
3222026-03-18T23:14:36.264ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:36.263027971Z } timeseries_name = switch_port_control_data_link:bytes_received
3232026-03-18T23:14:36.264ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
3242026-03-18T23:14:36.266ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:36.264613701Z } timeseries_name = switch_port_control_data_link:packets_received
3252026-03-18T23:14:36.266ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
3262026-03-18T23:14:36.267ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:36.266181152Z } timeseries_name = switch_port_control_data_link:bytes_sent
3272026-03-18T23:14:36.267ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
3282026-03-18T23:14:36.269ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-03-18T23:14:36.267812984Z } timeseries_name = switch_port_control_data_link:packets_sent
3292026-03-18T23:14:36.281ZDEBGoximeter (clickhouse-client): inserting 6 new timeseries schema collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
3302026-03-18T23:14:36.284ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 24 table_name = fields_i16
3312026-03-18T23:14:36.285ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 150 table_name = fields_string
3322026-03-18T23:14:36.287ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 12 table_name = fields_u16
3332026-03-18T23:14:36.288ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 24 table_name = fields_u32
3342026-03-18T23:14:36.289ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 12 table_name = fields_u8
3352026-03-18T23:14:36.291ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 72 table_name = fields_uuid
3362026-03-18T23:14:36.292ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 314 table_name = measurements_cumulativeu64
3372026-03-18T23:14:36.293ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 40 table_name = measurements_u64
3382026-03-18T23:14:36.322ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
3392026-03-18T23:14:36.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 6255051b-ca86-401d-9418-d4c725318530 producer_ip = fd00:1122:3344:101::2 producer_port = 51303
3402026-03-18T23:14:36.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3412026-03-18T23:14:36.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 6255051b-ca86-401d-9418-d4c725318530 producer_ip = fd00:1122:3344:101::2 producer_port = 51303
3422026-03-18T23:14:36.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3432026-03-18T23:14:36.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 169680fd-400d-4d9a-8dd1-1eab246fac7b producer_ip = fd00:1122:3344:101::a producer_port = 35411
3442026-03-18T23:14:36.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3452026-03-18T23:14:36.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3462026-03-18T23:14:36.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 169680fd-400d-4d9a-8dd1-1eab246fac7b producer_ip = fd00:1122:3344:101::a producer_port = 35411
3472026-03-18T23:14:36.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3482026-03-18T23:14:36.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 6255051b-ca86-401d-9418-d4c725318530 producer_ip = fd00:1122:3344:101::2 producer_port = 51303
3492026-03-18T23:14:36.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3502026-03-18T23:14:36.398ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 169680fd-400d-4d9a-8dd1-1eab246fac7b producer_ip = fd00:1122:3344:101::a producer_port = 35411
3512026-03-18T23:14:37.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3522026-03-18T23:14:37.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3532026-03-18T23:14:37.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3542026-03-18T23:14:37.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3552026-03-18T23:14:37.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3562026-03-18T23:14:37.397ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3572026-03-18T23:14:38.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3582026-03-18T23:14:38.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3592026-03-18T23:14:38.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3602026-03-18T23:14:38.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3612026-03-18T23:14:38.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3622026-03-18T23:14:38.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3632026-03-18T23:14:39.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3642026-03-18T23:14:39.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3652026-03-18T23:14:39.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3662026-03-18T23:14:39.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3672026-03-18T23:14:39.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3682026-03-18T23:14:39.397ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3692026-03-18T23:14:40.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3702026-03-18T23:14:40.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3712026-03-18T23:14:40.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3722026-03-18T23:14:40.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3732026-03-18T23:14:40.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3742026-03-18T23:14:40.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3752026-03-18T23:14:41.221ZDEBGoximeter (results-sink): inserting 187 samples into database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d
3762026-03-18T23:14:41.222ZDEBGoximeter (results-sink-cluster): inserting 187 samples into database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d
3772026-03-18T23:14:41.222ZDEBGoximeter (clickhouse-client): unrolling 187 total samples collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
3782026-03-18T23:14:41.231ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 104 table_name = fields_string
3792026-03-18T23:14:41.233ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 37 table_name = fields_u16
3802026-03-18T23:14:41.234ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 73 table_name = fields_uuid
3812026-03-18T23:14:41.235ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 110 table_name = measurements_cumulativeu64
3822026-03-18T23:14:41.238ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 37 table_name = measurements_histogramu64
3832026-03-18T23:14:41.239ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 40 table_name = measurements_u64
3842026-03-18T23:14:41.322ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
3852026-03-18T23:14:41.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3862026-03-18T23:14:41.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3872026-03-18T23:14:41.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3882026-03-18T23:14:41.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3892026-03-18T23:14:41.394ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3902026-03-18T23:14:41.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3912026-03-18T23:14:42.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3922026-03-18T23:14:42.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3932026-03-18T23:14:42.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3942026-03-18T23:14:42.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3952026-03-18T23:14:42.394ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3962026-03-18T23:14:42.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3972026-03-18T23:14:43.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3982026-03-18T23:14:43.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3992026-03-18T23:14:43.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4002026-03-18T23:14:43.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4012026-03-18T23:14:43.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4022026-03-18T23:14:43.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4032026-03-18T23:14:44.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4042026-03-18T23:14:44.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4052026-03-18T23:14:44.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4062026-03-18T23:14:44.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4072026-03-18T23:14:44.394ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4082026-03-18T23:14:44.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4092026-03-18T23:14:45.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4102026-03-18T23:14:45.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4112026-03-18T23:14:45.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4122026-03-18T23:14:45.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4132026-03-18T23:14:45.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4142026-03-18T23:14:45.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4152026-03-18T23:14:46.221ZDEBGoximeter (results-sink): inserting 150 samples into database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d
4162026-03-18T23:14:46.221ZDEBGoximeter (results-sink-cluster): inserting 150 samples into database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d
4172026-03-18T23:14:46.221ZDEBGoximeter (clickhouse-client): unrolling 150 total samples collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
4182026-03-18T23:14:46.229ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 30 table_name = fields_string
4192026-03-18T23:14:46.230ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 36 table_name = fields_uuid
4202026-03-18T23:14:46.232ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 110 table_name = measurements_cumulativeu64
4212026-03-18T23:14:46.233ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 40 table_name = measurements_u64
4222026-03-18T23:14:46.323ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
4232026-03-18T23:14:46.374ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
4242026-03-18T23:14:46.374ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/dd380624-e9b2-4c50-8300-64bae2e9a5ad/producers?sort_by=id_ascending
4252026-03-18T23:14:46.376ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/dd380624-e9b2-4c50-8300-64bae2e9a5ad/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4d9aaff-2dbb-4c24-8b84-004f60ee8fc8", "content-length": "995", "date": "Wed, 18 Mar 2026 23:14:46 GMT"} })
4262026-03-18T23:14:46.376ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/dd380624-e9b2-4c50-8300-64bae2e9a5ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZjhhM2Q1Yi1mMzRjLTRhZjQtOGJjOS02NzhmYjg1NmFmOGMifX0%3D
4272026-03-18T23:14:46.378ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/dd380624-e9b2-4c50-8300-64bae2e9a5ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZjhhM2Q1Yi1mMzRjLTRhZjQtOGJjOS02NzhmYjg1NmFmOGMifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "e75cfbcc-e332-4f34-9054-c63d62ac5a92", "content-length": "29", "date": "Wed, 18 Mar 2026 23:14:46 GMT"} })
4282026-03-18T23:14:46.378ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a
4292026-03-18T23:14:46.378ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 6 n_pruned_tasks = 0
4302026-03-18T23:14:46.379ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4312026-03-18T23:14:46.379ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4322026-03-18T23:14:46.380ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4332026-03-18T23:14:46.390ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4342026-03-18T23:14:46.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 6255051b-ca86-401d-9418-d4c725318530 producer_ip = fd00:1122:3344:101::2 producer_port = 51303
4352026-03-18T23:14:46.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4362026-03-18T23:14:46.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4372026-03-18T23:14:46.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 6255051b-ca86-401d-9418-d4c725318530 producer_ip = fd00:1122:3344:101::2 producer_port = 51303
4382026-03-18T23:14:46.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 169680fd-400d-4d9a-8dd1-1eab246fac7b producer_ip = fd00:1122:3344:101::a producer_port = 35411
4392026-03-18T23:14:46.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4402026-03-18T23:14:46.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 169680fd-400d-4d9a-8dd1-1eab246fac7b producer_ip = fd00:1122:3344:101::a producer_port = 35411
4412026-03-18T23:14:46.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4422026-03-18T23:14:46.394ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4432026-03-18T23:14:46.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 6255051b-ca86-401d-9418-d4c725318530 producer_ip = fd00:1122:3344:101::2 producer_port = 51303
4442026-03-18T23:14:46.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4452026-03-18T23:14:46.397ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 169680fd-400d-4d9a-8dd1-1eab246fac7b producer_ip = fd00:1122:3344:101::a producer_port = 35411
4462026-03-18T23:14:47.379ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4472026-03-18T23:14:47.379ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4482026-03-18T23:14:47.381ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4492026-03-18T23:14:47.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4502026-03-18T23:14:47.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4512026-03-18T23:14:47.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4522026-03-18T23:14:47.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4532026-03-18T23:14:47.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4542026-03-18T23:14:47.397ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4552026-03-18T23:14:48.380ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4562026-03-18T23:14:48.380ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4572026-03-18T23:14:48.381ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4582026-03-18T23:14:48.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4592026-03-18T23:14:48.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4602026-03-18T23:14:48.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4612026-03-18T23:14:48.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4622026-03-18T23:14:48.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4632026-03-18T23:14:48.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4642026-03-18T23:14:49.380ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4652026-03-18T23:14:49.380ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4662026-03-18T23:14:49.382ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4672026-03-18T23:14:49.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4682026-03-18T23:14:49.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4692026-03-18T23:14:49.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4702026-03-18T23:14:49.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4712026-03-18T23:14:49.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4722026-03-18T23:14:49.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4732026-03-18T23:14:50.379ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4742026-03-18T23:14:50.379ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4752026-03-18T23:14:50.381ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4762026-03-18T23:14:50.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4772026-03-18T23:14:50.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4782026-03-18T23:14:50.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4792026-03-18T23:14:50.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4802026-03-18T23:14:50.394ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4812026-03-18T23:14:50.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4822026-03-18T23:14:51.222ZDEBGoximeter (results-sink): inserting 258 samples into database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d
4832026-03-18T23:14:51.222ZDEBGoximeter (results-sink-cluster): inserting 258 samples into database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d
4842026-03-18T23:14:51.222ZDEBGoximeter (clickhouse-client): unrolling 258 total samples collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
4852026-03-18T23:14:51.234ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 2 table_name = fields_ipaddr
4862026-03-18T23:14:51.235ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 131 table_name = fields_string
4872026-03-18T23:14:51.237ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 39 table_name = fields_u16
4882026-03-18T23:14:51.238ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 103 table_name = fields_uuid
4892026-03-18T23:14:51.240ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 161 table_name = measurements_cumulativeu64
4902026-03-18T23:14:51.242ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 37 table_name = measurements_histogramu64
4912026-03-18T23:14:51.243ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 60 table_name = measurements_u64
4922026-03-18T23:14:51.323ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
4932026-03-18T23:14:51.379ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4942026-03-18T23:14:51.379ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4952026-03-18T23:14:51.381ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4962026-03-18T23:14:51.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4972026-03-18T23:14:51.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4982026-03-18T23:14:51.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4992026-03-18T23:14:51.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5002026-03-18T23:14:51.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5012026-03-18T23:14:51.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5022026-03-18T23:14:52.379ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5032026-03-18T23:14:52.379ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5042026-03-18T23:14:52.381ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5052026-03-18T23:14:52.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5062026-03-18T23:14:52.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5072026-03-18T23:14:52.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5082026-03-18T23:14:52.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5092026-03-18T23:14:52.394ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5102026-03-18T23:14:52.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5112026-03-18T23:14:53.380ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5122026-03-18T23:14:53.380ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5132026-03-18T23:14:53.382ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5142026-03-18T23:14:53.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5152026-03-18T23:14:53.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5162026-03-18T23:14:53.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5172026-03-18T23:14:53.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5182026-03-18T23:14:53.394ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5192026-03-18T23:14:53.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5202026-03-18T23:14:54.380ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5212026-03-18T23:14:54.380ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5222026-03-18T23:14:54.382ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5232026-03-18T23:14:54.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5242026-03-18T23:14:54.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5252026-03-18T23:14:54.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5262026-03-18T23:14:54.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5272026-03-18T23:14:54.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5282026-03-18T23:14:54.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5292026-03-18T23:14:55.380ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5302026-03-18T23:14:55.380ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5312026-03-18T23:14:55.381ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5322026-03-18T23:14:55.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5332026-03-18T23:14:55.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5342026-03-18T23:14:55.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5352026-03-18T23:14:55.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5362026-03-18T23:14:55.394ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5372026-03-18T23:14:55.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5382026-03-18T23:14:56.221ZDEBGoximeter (results-sink): inserting 220 samples into database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d
5392026-03-18T23:14:56.221ZDEBGoximeter (results-sink-cluster): inserting 220 samples into database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d
5402026-03-18T23:14:56.221ZDEBGoximeter (clickhouse-client): unrolling 220 total samples collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
5412026-03-18T23:14:56.232ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 56 table_name = fields_string
5422026-03-18T23:14:56.233ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 64 table_name = fields_uuid
5432026-03-18T23:14:56.234ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 160 table_name = measurements_cumulativeu64
5442026-03-18T23:14:56.236ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 60 table_name = measurements_u64
5452026-03-18T23:14:56.323ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
5462026-03-18T23:14:56.379ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5472026-03-18T23:14:56.379ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5482026-03-18T23:14:56.381ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5492026-03-18T23:14:56.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 6255051b-ca86-401d-9418-d4c725318530 producer_ip = fd00:1122:3344:101::2 producer_port = 51303
5502026-03-18T23:14:56.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5512026-03-18T23:14:56.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 6255051b-ca86-401d-9418-d4c725318530 producer_ip = fd00:1122:3344:101::2 producer_port = 51303
5522026-03-18T23:14:56.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5532026-03-18T23:14:56.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 169680fd-400d-4d9a-8dd1-1eab246fac7b producer_ip = fd00:1122:3344:101::a producer_port = 35411
5542026-03-18T23:14:56.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5552026-03-18T23:14:56.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5562026-03-18T23:14:56.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 169680fd-400d-4d9a-8dd1-1eab246fac7b producer_ip = fd00:1122:3344:101::a producer_port = 35411
5572026-03-18T23:14:56.394ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5582026-03-18T23:14:56.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 6255051b-ca86-401d-9418-d4c725318530 producer_ip = fd00:1122:3344:101::2 producer_port = 51303
5592026-03-18T23:14:56.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5602026-03-18T23:14:56.397ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 169680fd-400d-4d9a-8dd1-1eab246fac7b producer_ip = fd00:1122:3344:101::a producer_port = 35411
5612026-03-18T23:14:57.379ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5622026-03-18T23:14:57.379ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5632026-03-18T23:14:57.381ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5642026-03-18T23:14:57.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5652026-03-18T23:14:57.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5662026-03-18T23:14:57.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5672026-03-18T23:14:57.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5682026-03-18T23:14:57.394ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5692026-03-18T23:14:57.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5702026-03-18T23:14:58.380ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5712026-03-18T23:14:58.380ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5722026-03-18T23:14:58.381ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5732026-03-18T23:14:58.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5742026-03-18T23:14:58.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5752026-03-18T23:14:58.393ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5762026-03-18T23:14:58.393ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5772026-03-18T23:14:58.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5782026-03-18T23:14:58.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5792026-03-18T23:14:59.379ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5802026-03-18T23:14:59.379ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5812026-03-18T23:14:59.381ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5822026-03-18T23:14:59.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5832026-03-18T23:14:59.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5842026-03-18T23:14:59.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5852026-03-18T23:14:59.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5862026-03-18T23:14:59.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5872026-03-18T23:14:59.396ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5882026-03-18T23:15:00.379ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5892026-03-18T23:15:00.379ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5902026-03-18T23:15:00.382ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5912026-03-18T23:15:00.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5922026-03-18T23:15:00.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5932026-03-18T23:15:00.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5942026-03-18T23:15:00.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5952026-03-18T23:15:00.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5962026-03-18T23:15:00.397ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5972026-03-18T23:15:01.221ZDEBGoximeter (results-sink): inserting 257 samples into database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d
5982026-03-18T23:15:01.221ZDEBGoximeter (results-sink-cluster): inserting 257 samples into database collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d
5992026-03-18T23:15:01.221ZDEBGoximeter (clickhouse-client): unrolling 257 total samples collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db
6002026-03-18T23:15:01.246ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 130 table_name = fields_string
6012026-03-18T23:15:01.247ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 37 table_name = fields_u16
6022026-03-18T23:15:01.249ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 101 table_name = fields_uuid
6032026-03-18T23:15:01.250ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 160 table_name = measurements_cumulativeu64
6042026-03-18T23:15:01.253ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 37 table_name = measurements_histogramu64
6052026-03-18T23:15:01.254ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d id = 8745619e-fb68-4493-ab54-166ae26a65db n_rows = 60 table_name = measurements_u64
6062026-03-18T23:15:01.322ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
6072026-03-18T23:15:01.374ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
6082026-03-18T23:15:01.374ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/dd380624-e9b2-4c50-8300-64bae2e9a5ad/producers?sort_by=id_ascending
6092026-03-18T23:15:01.377ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/dd380624-e9b2-4c50-8300-64bae2e9a5ad/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb06ab24-f288-4f08-ad02-cbdda7dea797", "content-length": "1133", "date": "Wed, 18 Mar 2026 23:15:01 GMT"} })
6102026-03-18T23:15:01.377ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/dd380624-e9b2-4c50-8300-64bae2e9a5ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDJhZWQ0Ny1mMzc2LTQwYzMtYWQ5Zi04NTgzYWM2ZWIzNjMifX0%3D
6112026-03-18T23:15:01.380ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6122026-03-18T23:15:01.380ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6132026-03-18T23:15:01.380ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 8c76a14a-af59-415c-a84d-6b642a24a417 producer_ip = fd00:1122:3344:101::2 producer_port = 61088
6142026-03-18T23:15:01.380ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 8c76a14a-af59-415c-a84d-6b642a24a417 producer_ip = fd00:1122:3344:101::2 producer_port = 61088
6152026-03-18T23:15:01.380ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/dd380624-e9b2-4c50-8300-64bae2e9a5ad/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDJhZWQ0Ny1mMzc2LTQwYzMtYWQ5Zi04NTgzYWM2ZWIzNjMifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdc3e461-f77c-4e74-bb43-201051b98b7c", "content-length": "29", "date": "Wed, 18 Mar 2026 23:15:01 GMT"} })
6162026-03-18T23:15:01.380ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:54246 collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = ed2aed47-f376-40c3-ad9f-8583ac6eb363
6172026-03-18T23:15:01.380ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 7 n_pruned_tasks = 0
6182026-03-18T23:15:01.381ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6192026-03-18T23:15:01.382ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = ed2aed47-f376-40c3-ad9f-8583ac6eb363 producer_ip = fd00:1122:3344:101::b producer_port = 54246
6202026-03-18T23:15:01.382ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = ed2aed47-f376-40c3-ad9f-8583ac6eb363 producer_ip = fd00:1122:3344:101::b producer_port = 54246
6212026-03-18T23:15:01.382ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = ed2aed47-f376-40c3-ad9f-8583ac6eb363 producer_ip = fd00:1122:3344:101::b producer_port = 54246
6222026-03-18T23:15:01.383ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8c76a14a-af59-415c-a84d-6b642a24a417 producer_ip = fd00:1122:3344:101::2 producer_port = 61088
6232026-03-18T23:15:01.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6242026-03-18T23:15:01.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6252026-03-18T23:15:01.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6262026-03-18T23:15:01.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6272026-03-18T23:15:01.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6282026-03-18T23:15:01.397ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = ed2aed47-f376-40c3-ad9f-8583ac6eb363 producer_ip = fd00:1122:3344:101::b producer_port = 54246
6292026-03-18T23:15:01.397ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6302026-03-18T23:15:02.380ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6312026-03-18T23:15:02.380ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6322026-03-18T23:15:02.381ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 143abda5-b4d4-4569-9ecf-210997a9631a producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6332026-03-18T23:15:02.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6342026-03-18T23:15:02.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6352026-03-18T23:15:02.394ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6362026-03-18T23:15:02.394ZDEBGoximeter (collection-task): collecting from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6372026-03-18T23:15:02.395ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = bf8a3d5b-f34c-4af4-8bc9-678fb856af8c producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6382026-03-18T23:15:02.397ZDEBGoximeter (collection-task): collected results from producer collector_id = dd380624-e9b2-4c50-8300-64bae2e9a5ad collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 17379ca7-1b7f-4e46-afe8-a20b41936d13 producer_ip = fd00:1122:3344:101::1 producer_port = 8001