Max level shown:
1 [ Dec 29 09:28:36 Enabled. ]
2 [ Dec 29 09:28:36 Rereading configuration. ]
3 [ Dec 29 09:28:38 Rereading configuration. ]
4 [ Dec 29 09:28:42 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id 9f715b7c-ddc5-4985-995d-18df85af22a1 &"). ]
5 [ Dec 29 09:28:42 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72025-12-29T09:28:43.068ZDEBGoximeter: registered DTrace probes
82025-12-29T09:28:43.076ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:264
92025-12-29T09:28:43.083ZDEBGoximeter: creating ClickHouse client
102025-12-29T09:28:43.157ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
112025-12-29T09:28:53.694ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:900 id = 66fb339f-745c-4217-8188-a7bb2b0376aa
122025-12-29T09:28:53.694ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d
132025-12-29T09:28:53.694ZINFOoximeter (clickhouse-client): reading db version collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:800 id = 66fb339f-745c-4217-8188-a7bb2b0376aa
142025-12-29T09:28:53.695ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:900 id = 66fb339f-745c-4217-8188-a7bb2b0376aa
152025-12-29T09:28:53.695ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:805 id = 66fb339f-745c-4217-8188-a7bb2b0376aa version = 0
162025-12-29T09:28:53.695ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:810 id = 66fb339f-745c-4217-8188-a7bb2b0376aa
172025-12-29T09:28:53.696ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
182025-12-29T09:28:55.245ZINFOoximeter (clickhouse-client): inserting current version collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:831 id = 66fb339f-745c-4217-8188-a7bb2b0376aa version = 14
192025-12-29T09:28:55.319ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 47b3e4d8-3199-4156-b0f2-2655af3605a1
202025-12-29T09:28:55.469ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212025-12-29T09:28:55.469ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222025-12-29T09:28:55.469ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232025-12-29T09:28:55.469ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242025-12-29T09:28:55.469ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.6/src/server.rs:328 local_addr = [fd00:1122:3344:101::d]:12223
252025-12-29T09:28:55.527ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262025-12-29T09:28:55.527ZDEBGoximeter: registered USDT probes
272025-12-29T09:28:55.527ZDEBGoximeter: contacting nexus
282025-12-29T09:28:55.880ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
292025-12-29T09:28:56.339ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "c2191d01-47e1-4d76-807c-b7500ea7aa21", "date": "Mon, 29 Dec 2025 09:28:56 GMT"} })
302025-12-29T09:28:56.339ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:427 id = 9f715b7c-ddc5-4985-995d-18df85af22a1
312025-12-29T09:28:56.340ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:554
322025-12-29T09:28:56.341ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
332025-12-29T09:28:56.349ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/9f715b7c-ddc5-4985-995d-18df85af22a1/producers?sort_by=id_ascending
342025-12-29T09:28:56.520ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/9f715b7c-ddc5-4985-995d-18df85af22a1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "773b4220-6262-483d-abbd-8669f1b84e91", "content-length": "29", "date": "Mon, 29 Dec 2025 09:28:56 GMT"} })
352025-12-29T09:28:56.520ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 0 n_pruned_tasks = 0
362025-12-29T09:29:11.341ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
372025-12-29T09:29:11.341ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/9f715b7c-ddc5-4985-995d-18df85af22a1/producers?sort_by=id_ascending
382025-12-29T09:29:11.350ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/9f715b7c-ddc5-4985-995d-18df85af22a1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8f6be17-47f2-4ddd-8557-53b6cc60b728", "content-length": "995", "date": "Mon, 29 Dec 2025 09:29:11 GMT"} })
392025-12-29T09:29:11.354ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/9f715b7c-ddc5-4985-995d-18df85af22a1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNmM2NjQ4Ni1mYjdkLTQxNzgtODk2NS1kODUwMDBjNWU0MjUifX0%3D
402025-12-29T09:29:11.357ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/9f715b7c-ddc5-4985-995d-18df85af22a1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNmM2NjQ4Ni1mYjdkLTQxNzgtODk2NS1kODUwMDBjNWU0MjUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "e07f0aca-cbc0-4f9b-a6ac-0e8fdb076f60", "content-length": "29", "date": "Mon, 29 Dec 2025 09:29:11 GMT"} })
412025-12-29T09:29:11.357ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae
422025-12-29T09:29:11.360ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511
432025-12-29T09:29:11.360ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:65313 collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 88cdb129-37c2-4c90-ac1d-c3d882f3801e
442025-12-29T09:29:11.360ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:61478 collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = a5bdd775-0d59-4c97-ae3d-926939837c7a
452025-12-29T09:29:11.360ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:60641 collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = dc6ec0ed-77d4-47c3-86be-8b195e9e3ac6
462025-12-29T09:29:11.360ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425
472025-12-29T09:29:11.360ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 6 n_pruned_tasks = 0
482025-12-29T09:29:11.362ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
492025-12-29T09:29:11.362ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
502025-12-29T09:29:11.362ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
512025-12-29T09:29:11.363ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = dc6ec0ed-77d4-47c3-86be-8b195e9e3ac6 producer_ip = fd00:1122:3344:101::2 producer_port = 60641
522025-12-29T09:29:11.363ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 88cdb129-37c2-4c90-ac1d-c3d882f3801e producer_ip = fd00:1122:3344:101::b producer_port = 65313
532025-12-29T09:29:11.363ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = a5bdd775-0d59-4c97-ae3d-926939837c7a producer_ip = fd00:1122:3344:101::2 producer_port = 61478
542025-12-29T09:29:11.398ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
552025-12-29T09:29:11.398ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 88cdb129-37c2-4c90-ac1d-c3d882f3801e producer_ip = fd00:1122:3344:101::b producer_port = 65313
562025-12-29T09:29:11.398ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
572025-12-29T09:29:11.398ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = dc6ec0ed-77d4-47c3-86be-8b195e9e3ac6 producer_ip = fd00:1122:3344:101::2 producer_port = 60641
582025-12-29T09:29:11.398ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
592025-12-29T09:29:11.398ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = a5bdd775-0d59-4c97-ae3d-926939837c7a producer_ip = fd00:1122:3344:101::2 producer_port = 61478
602025-12-29T09:29:11.561ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
612025-12-29T09:29:11.570ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
622025-12-29T09:29:11.578ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
632025-12-29T09:29:11.581ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
642025-12-29T09:29:11.670ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 88cdb129-37c2-4c90-ac1d-c3d882f3801e producer_ip = fd00:1122:3344:101::b producer_port = 65313
652025-12-29T09:29:11.674ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 88cdb129-37c2-4c90-ac1d-c3d882f3801e producer_ip = fd00:1122:3344:101::b producer_port = 65313
662025-12-29T09:29:11.682ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = dc6ec0ed-77d4-47c3-86be-8b195e9e3ac6 producer_ip = fd00:1122:3344:101::2 producer_port = 60641
672025-12-29T09:29:11.687ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = a5bdd775-0d59-4c97-ae3d-926939837c7a producer_ip = fd00:1122:3344:101::2 producer_port = 61478
682025-12-29T09:29:11.687ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
692025-12-29T09:29:11.703ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
702025-12-29T09:29:11.706ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = a5bdd775-0d59-4c97-ae3d-926939837c7a producer_ip = fd00:1122:3344:101::2 producer_port = 61478
712025-12-29T09:29:11.715ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = dc6ec0ed-77d4-47c3-86be-8b195e9e3ac6 producer_ip = fd00:1122:3344:101::2 producer_port = 60641
722025-12-29T09:29:12.360ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
732025-12-29T09:29:12.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
742025-12-29T09:29:12.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
752025-12-29T09:29:12.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
762025-12-29T09:29:12.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
772025-12-29T09:29:12.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
782025-12-29T09:29:12.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
792025-12-29T09:29:12.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
802025-12-29T09:29:12.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
812025-12-29T09:29:13.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
822025-12-29T09:29:13.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
832025-12-29T09:29:13.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
842025-12-29T09:29:13.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
852025-12-29T09:29:13.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
862025-12-29T09:29:13.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
872025-12-29T09:29:13.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
882025-12-29T09:29:13.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
892025-12-29T09:29:13.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
902025-12-29T09:29:14.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
912025-12-29T09:29:14.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
922025-12-29T09:29:14.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
932025-12-29T09:29:14.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
942025-12-29T09:29:14.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
952025-12-29T09:29:14.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
962025-12-29T09:29:14.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
972025-12-29T09:29:14.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
982025-12-29T09:29:14.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
992025-12-29T09:29:15.321ZDEBGoximeter (results-sink): inserting 383 samples into database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d
1002025-12-29T09:29:15.321ZDEBGoximeter (results-sink-cluster): inserting 383 samples into database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d
1012025-12-29T09:29:15.321ZDEBGoximeter (clickhouse-client): unrolling 383 total samples collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1022025-12-29T09:29:15.322ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1032025-12-29T09:29:15.323ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.322083185Z } timeseries_name = oximeter_collector:collections
1042025-12-29T09:29:15.334ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1052025-12-29T09:29:15.345ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.333997453Z } timeseries_name = ddm_router:originated_underlay_prefixes
1062025-12-29T09:29:15.345ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1072025-12-29T09:29:15.350ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.345553256Z } timeseries_name = ddm_router:originated_tunnel_endpoints
1082025-12-29T09:29:15.351ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1092025-12-29T09:29:15.352ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.351073173Z } timeseries_name = ddm_session:solicitations_sent
1102025-12-29T09:29:15.352ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1112025-12-29T09:29:15.353ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.352149181Z } timeseries_name = ddm_session:solicitations_received
1122025-12-29T09:29:15.353ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1132025-12-29T09:29:15.354ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.353162889Z } timeseries_name = ddm_session:advertisements_sent
1142025-12-29T09:29:15.354ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1152025-12-29T09:29:15.355ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.354139826Z } timeseries_name = ddm_session:advertisements_received
1162025-12-29T09:29:15.355ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1172025-12-29T09:29:15.355ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.355086913Z } timeseries_name = ddm_session:peer_expirations
1182025-12-29T09:29:15.356ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1192025-12-29T09:29:15.356ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.356076690Z } timeseries_name = ddm_session:peer_address_changes
1202025-12-29T09:29:15.357ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1212025-12-29T09:29:15.357ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.357044497Z } timeseries_name = ddm_session:peer_sessions_established
1222025-12-29T09:29:15.358ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1232025-12-29T09:29:15.359ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.358045205Z } timeseries_name = ddm_session:updates_sent
1242025-12-29T09:29:15.359ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1252025-12-29T09:29:15.360ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.359237376Z } timeseries_name = ddm_session:updates_received
1262025-12-29T09:29:15.360ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1272025-12-29T09:29:15.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1282025-12-29T09:29:15.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1292025-12-29T09:29:15.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1302025-12-29T09:29:15.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1312025-12-29T09:29:15.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1322025-12-29T09:29:15.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1332025-12-29T09:29:15.361ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.360439607Z } timeseries_name = ddm_session:update_send_fail
1342025-12-29T09:29:15.361ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1352025-12-29T09:29:15.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1362025-12-29T09:29:15.362ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.361459304Z } timeseries_name = ddm_session:imported_underlay_prefixes
1372025-12-29T09:29:15.362ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1382025-12-29T09:29:15.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1392025-12-29T09:29:15.363ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.362451672Z } timeseries_name = ddm_session:imported_tunnel_endpoints
1402025-12-29T09:29:15.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1412025-12-29T09:29:15.364ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1422025-12-29T09:29:15.365ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.364533169Z } timeseries_name = http_service:request_latency_histogram
1432025-12-29T09:29:15.366ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1442025-12-29T09:29:15.367ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.366046645Z } timeseries_name = collection_target:cpus_provisioned
1452025-12-29T09:29:15.367ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1462025-12-29T09:29:15.368ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.367069523Z } timeseries_name = collection_target:ram_provisioned
1472025-12-29T09:29:15.368ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1482025-12-29T09:29:15.369ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.368406186Z } timeseries_name = collection_target:virtual_disk_space_provisioned
1492025-12-29T09:29:15.369ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1502025-12-29T09:29:15.370ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.369556246Z } timeseries_name = static_routing_config:static_routes
1512025-12-29T09:29:15.370ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1522025-12-29T09:29:15.371ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.370548514Z } timeseries_name = static_routing_config:static_nexthops
1532025-12-29T09:29:15.371ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1542025-12-29T09:29:15.372ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.371549601Z } timeseries_name = switch_rib:active_routes
1552025-12-29T09:29:15.372ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1562025-12-29T09:29:15.373ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.372544779Z } timeseries_name = mg_lower:routes_blocked_by_link_state
1572025-12-29T09:29:15.374ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1582025-12-29T09:29:15.375ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.374283239Z } timeseries_name = switch_port_control_data_link:errors_received
1592025-12-29T09:29:15.375ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1602025-12-29T09:29:15.376ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.375418359Z } timeseries_name = switch_port_control_data_link:errors_sent
1612025-12-29T09:29:15.376ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1622025-12-29T09:29:15.377ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.376769273Z } timeseries_name = switch_port_control_data_link:bytes_received
1632025-12-29T09:29:15.377ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1642025-12-29T09:29:15.378ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.377885103Z } timeseries_name = switch_port_control_data_link:packets_received
1652025-12-29T09:29:15.379ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1662025-12-29T09:29:15.380ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.379113014Z } timeseries_name = switch_port_control_data_link:bytes_sent
1672025-12-29T09:29:15.380ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1682025-12-29T09:29:15.381ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:15.380272964Z } timeseries_name = switch_port_control_data_link:packets_sent
1692025-12-29T09:29:15.395ZDEBGoximeter (clickhouse-client): inserting 29 new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
1702025-12-29T09:29:15.411ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 24 table_name = fields_i16
1712025-12-29T09:29:15.413ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 12 table_name = fields_ipaddr
1722025-12-29T09:29:15.415ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 212 table_name = fields_string
1732025-12-29T09:29:15.417ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 39 table_name = fields_u16
1742025-12-29T09:29:15.419ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 24 table_name = fields_u32
1752025-12-29T09:29:15.425ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
1762025-12-29T09:29:15.425ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 12 table_name = fields_u8
1772025-12-29T09:29:15.427ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 133 table_name = fields_uuid
1782025-12-29T09:29:15.436ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 314 table_name = measurements_cumulativeu64
1792025-12-29T09:29:15.443ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 15 table_name = measurements_histogramu64
1802025-12-29T09:29:15.445ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 6 table_name = measurements_i64
1812025-12-29T09:29:15.447ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 48 table_name = measurements_u64
1822025-12-29T09:29:16.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1832025-12-29T09:29:16.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1842025-12-29T09:29:16.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1852025-12-29T09:29:16.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1862025-12-29T09:29:16.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1872025-12-29T09:29:16.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1882025-12-29T09:29:16.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1892025-12-29T09:29:16.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1902025-12-29T09:29:16.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1912025-12-29T09:29:17.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1922025-12-29T09:29:17.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1932025-12-29T09:29:17.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1942025-12-29T09:29:17.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1952025-12-29T09:29:17.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1962025-12-29T09:29:17.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1972025-12-29T09:29:17.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1982025-12-29T09:29:17.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1992025-12-29T09:29:17.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2002025-12-29T09:29:18.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2012025-12-29T09:29:18.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2022025-12-29T09:29:18.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2032025-12-29T09:29:18.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2042025-12-29T09:29:18.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2052025-12-29T09:29:18.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2062025-12-29T09:29:18.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2072025-12-29T09:29:18.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2082025-12-29T09:29:18.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2092025-12-29T09:29:19.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2102025-12-29T09:29:19.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2112025-12-29T09:29:19.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2122025-12-29T09:29:19.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2132025-12-29T09:29:19.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2142025-12-29T09:29:19.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2152025-12-29T09:29:19.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2162025-12-29T09:29:19.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2172025-12-29T09:29:19.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2182025-12-29T09:29:20.321ZDEBGoximeter (results-sink-cluster): inserting 220 samples into database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d
2192025-12-29T09:29:20.321ZDEBGoximeter (results-sink): inserting 220 samples into database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d
2202025-12-29T09:29:20.321ZDEBGoximeter (clickhouse-client): unrolling 220 total samples collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
2212025-12-29T09:29:20.331ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 56 table_name = fields_string
2222025-12-29T09:29:20.333ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 64 table_name = fields_uuid
2232025-12-29T09:29:20.335ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 160 table_name = measurements_cumulativeu64
2242025-12-29T09:29:20.337ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 60 table_name = measurements_u64
2252025-12-29T09:29:20.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2262025-12-29T09:29:20.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2272025-12-29T09:29:20.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2282025-12-29T09:29:20.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2292025-12-29T09:29:20.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2302025-12-29T09:29:20.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2312025-12-29T09:29:20.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2322025-12-29T09:29:20.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2332025-12-29T09:29:20.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2342025-12-29T09:29:20.422ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
2352025-12-29T09:29:21.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 88cdb129-37c2-4c90-ac1d-c3d882f3801e producer_ip = fd00:1122:3344:101::b producer_port = 65313
2362025-12-29T09:29:21.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2372025-12-29T09:29:21.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 88cdb129-37c2-4c90-ac1d-c3d882f3801e producer_ip = fd00:1122:3344:101::b producer_port = 65313
2382025-12-29T09:29:21.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2392025-12-29T09:29:21.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2402025-12-29T09:29:21.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2412025-12-29T09:29:21.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = a5bdd775-0d59-4c97-ae3d-926939837c7a producer_ip = fd00:1122:3344:101::2 producer_port = 61478
2422025-12-29T09:29:21.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = a5bdd775-0d59-4c97-ae3d-926939837c7a producer_ip = fd00:1122:3344:101::2 producer_port = 61478
2432025-12-29T09:29:21.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2442025-12-29T09:29:21.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2452025-12-29T09:29:21.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2462025-12-29T09:29:21.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2472025-12-29T09:29:21.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2482025-12-29T09:29:21.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = a5bdd775-0d59-4c97-ae3d-926939837c7a producer_ip = fd00:1122:3344:101::2 producer_port = 61478
2492025-12-29T09:29:21.366ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 88cdb129-37c2-4c90-ac1d-c3d882f3801e producer_ip = fd00:1122:3344:101::b producer_port = 65313
2502025-12-29T09:29:22.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2512025-12-29T09:29:22.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2522025-12-29T09:29:22.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2532025-12-29T09:29:22.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2542025-12-29T09:29:22.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2552025-12-29T09:29:22.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2562025-12-29T09:29:22.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2572025-12-29T09:29:22.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2582025-12-29T09:29:22.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2592025-12-29T09:29:23.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2602025-12-29T09:29:23.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2612025-12-29T09:29:23.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2622025-12-29T09:29:23.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2632025-12-29T09:29:23.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2642025-12-29T09:29:23.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2652025-12-29T09:29:23.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2662025-12-29T09:29:23.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2672025-12-29T09:29:23.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2682025-12-29T09:29:24.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2692025-12-29T09:29:24.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2702025-12-29T09:29:24.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2712025-12-29T09:29:24.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2722025-12-29T09:29:24.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2732025-12-29T09:29:24.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2742025-12-29T09:29:24.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2752025-12-29T09:29:24.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2762025-12-29T09:29:24.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2772025-12-29T09:29:25.321ZDEBGoximeter (results-sink): inserting 270 samples into database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d
2782025-12-29T09:29:25.321ZDEBGoximeter (results-sink-cluster): inserting 270 samples into database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d
2792025-12-29T09:29:25.321ZDEBGoximeter (clickhouse-client): unrolling 270 total samples collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
2802025-12-29T09:29:25.334ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 126 table_name = fields_string
2812025-12-29T09:29:25.336ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 35 table_name = fields_u16
2822025-12-29T09:29:25.338ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 107 table_name = fields_uuid
2832025-12-29T09:29:25.339ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 160 table_name = measurements_cumulativeu64
2842025-12-29T09:29:25.342ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 35 table_name = measurements_histogramu64
2852025-12-29T09:29:25.344ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 15 table_name = measurements_i64
2862025-12-29T09:29:25.345ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 60 table_name = measurements_u64
2872025-12-29T09:29:25.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2882025-12-29T09:29:25.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2892025-12-29T09:29:25.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2902025-12-29T09:29:25.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2912025-12-29T09:29:25.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2922025-12-29T09:29:25.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2932025-12-29T09:29:25.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2942025-12-29T09:29:25.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2952025-12-29T09:29:25.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2962025-12-29T09:29:25.422ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
2972025-12-29T09:29:26.341ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
2982025-12-29T09:29:26.341ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/9f715b7c-ddc5-4985-995d-18df85af22a1/producers?sort_by=id_ascending
2992025-12-29T09:29:26.345ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/9f715b7c-ddc5-4985-995d-18df85af22a1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "272755dd-6a08-4f3f-965b-b9cd859b2e85", "content-length": "995", "date": "Mon, 29 Dec 2025 09:29:26 GMT"} })
3002025-12-29T09:29:26.345ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/9f715b7c-ddc5-4985-995d-18df85af22a1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNmM2NjQ4Ni1mYjdkLTQxNzgtODk2NS1kODUwMDBjNWU0MjUifX0%3D
3012025-12-29T09:29:26.360ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/9f715b7c-ddc5-4985-995d-18df85af22a1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNmM2NjQ4Ni1mYjdkLTQxNzgtODk2NS1kODUwMDBjNWU0MjUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "93c725dc-b772-426d-8e0c-fad88c15ffd6", "content-length": "29", "date": "Mon, 29 Dec 2025 09:29:26 GMT"} })
3022025-12-29T09:29:26.360ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 6 n_pruned_tasks = 0
3032025-12-29T09:29:26.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3042025-12-29T09:29:26.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3052025-12-29T09:29:26.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3062025-12-29T09:29:26.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3072025-12-29T09:29:26.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3082025-12-29T09:29:26.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3092025-12-29T09:29:26.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3102025-12-29T09:29:26.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3112025-12-29T09:29:26.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3122025-12-29T09:29:27.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3132025-12-29T09:29:27.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3142025-12-29T09:29:27.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3152025-12-29T09:29:27.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3162025-12-29T09:29:27.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3172025-12-29T09:29:27.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3182025-12-29T09:29:27.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3192025-12-29T09:29:27.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3202025-12-29T09:29:27.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3212025-12-29T09:29:28.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3222025-12-29T09:29:28.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3232025-12-29T09:29:28.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3242025-12-29T09:29:28.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3252025-12-29T09:29:28.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3262025-12-29T09:29:28.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3272025-12-29T09:29:28.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3282025-12-29T09:29:28.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3292025-12-29T09:29:28.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3302025-12-29T09:29:29.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3312025-12-29T09:29:29.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3322025-12-29T09:29:29.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3332025-12-29T09:29:29.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3342025-12-29T09:29:29.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3352025-12-29T09:29:29.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3362025-12-29T09:29:29.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3372025-12-29T09:29:29.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3382025-12-29T09:29:29.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3392025-12-29T09:29:30.321ZDEBGoximeter (results-sink): inserting 220 samples into database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d
3402025-12-29T09:29:30.321ZDEBGoximeter (results-sink-cluster): inserting 220 samples into database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d
3412025-12-29T09:29:30.321ZDEBGoximeter (clickhouse-client): unrolling 220 total samples collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
3422025-12-29T09:29:30.332ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 56 table_name = fields_string
3432025-12-29T09:29:30.334ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 64 table_name = fields_uuid
3442025-12-29T09:29:30.336ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 160 table_name = measurements_cumulativeu64
3452025-12-29T09:29:30.338ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 60 table_name = measurements_u64
3462025-12-29T09:29:30.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3472025-12-29T09:29:30.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3482025-12-29T09:29:30.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3492025-12-29T09:29:30.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3502025-12-29T09:29:30.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3512025-12-29T09:29:30.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3522025-12-29T09:29:30.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3532025-12-29T09:29:30.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3542025-12-29T09:29:30.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3552025-12-29T09:29:30.422ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
3562025-12-29T09:29:31.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 88cdb129-37c2-4c90-ac1d-c3d882f3801e producer_ip = fd00:1122:3344:101::b producer_port = 65313
3572025-12-29T09:29:31.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3582025-12-29T09:29:31.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3592025-12-29T09:29:31.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = a5bdd775-0d59-4c97-ae3d-926939837c7a producer_ip = fd00:1122:3344:101::2 producer_port = 61478
3602025-12-29T09:29:31.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 88cdb129-37c2-4c90-ac1d-c3d882f3801e producer_ip = fd00:1122:3344:101::b producer_port = 65313
3612025-12-29T09:29:31.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3622025-12-29T09:29:31.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3632025-12-29T09:29:31.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = a5bdd775-0d59-4c97-ae3d-926939837c7a producer_ip = fd00:1122:3344:101::2 producer_port = 61478
3642025-12-29T09:29:31.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3652025-12-29T09:29:31.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3662025-12-29T09:29:31.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3672025-12-29T09:29:31.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3682025-12-29T09:29:31.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = a5bdd775-0d59-4c97-ae3d-926939837c7a producer_ip = fd00:1122:3344:101::2 producer_port = 61478
3692025-12-29T09:29:31.365ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3702025-12-29T09:29:31.365ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 88cdb129-37c2-4c90-ac1d-c3d882f3801e producer_ip = fd00:1122:3344:101::b producer_port = 65313
3712025-12-29T09:29:32.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3722025-12-29T09:29:32.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3732025-12-29T09:29:32.362ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3742025-12-29T09:29:32.362ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3752025-12-29T09:29:32.362ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3762025-12-29T09:29:32.362ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3772025-12-29T09:29:32.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3782025-12-29T09:29:32.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3792025-12-29T09:29:32.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3802025-12-29T09:29:33.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3812025-12-29T09:29:33.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3822025-12-29T09:29:33.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3832025-12-29T09:29:33.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3842025-12-29T09:29:33.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3852025-12-29T09:29:33.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3862025-12-29T09:29:33.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3872025-12-29T09:29:33.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3882025-12-29T09:29:33.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3892025-12-29T09:29:34.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3902025-12-29T09:29:34.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3912025-12-29T09:29:34.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3922025-12-29T09:29:34.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3932025-12-29T09:29:34.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3942025-12-29T09:29:34.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3952025-12-29T09:29:34.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3962025-12-29T09:29:34.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3972025-12-29T09:29:34.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3982025-12-29T09:29:35.321ZDEBGoximeter (results-sink): inserting 255 samples into database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d
3992025-12-29T09:29:35.321ZDEBGoximeter (results-sink-cluster): inserting 255 samples into database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d
4002025-12-29T09:29:35.321ZDEBGoximeter (clickhouse-client): unrolling 255 total samples collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
4012025-12-29T09:29:35.334ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 126 table_name = fields_string
4022025-12-29T09:29:35.336ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 35 table_name = fields_u16
4032025-12-29T09:29:35.338ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 99 table_name = fields_uuid
4042025-12-29T09:29:35.340ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 160 table_name = measurements_cumulativeu64
4052025-12-29T09:29:35.342ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 35 table_name = measurements_histogramu64
4062025-12-29T09:29:35.344ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 60 table_name = measurements_u64
4072025-12-29T09:29:35.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4082025-12-29T09:29:35.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4092025-12-29T09:29:35.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4102025-12-29T09:29:35.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4112025-12-29T09:29:35.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4122025-12-29T09:29:35.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4132025-12-29T09:29:35.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4142025-12-29T09:29:35.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4152025-12-29T09:29:35.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4162025-12-29T09:29:35.422ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
4172025-12-29T09:29:36.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4182025-12-29T09:29:36.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4192025-12-29T09:29:36.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4202025-12-29T09:29:36.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4212025-12-29T09:29:36.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4222025-12-29T09:29:36.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4232025-12-29T09:29:36.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4242025-12-29T09:29:36.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4252025-12-29T09:29:36.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4262025-12-29T09:29:37.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4272025-12-29T09:29:37.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4282025-12-29T09:29:37.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4292025-12-29T09:29:37.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4302025-12-29T09:29:37.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4312025-12-29T09:29:37.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4322025-12-29T09:29:37.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4332025-12-29T09:29:37.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4342025-12-29T09:29:37.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4352025-12-29T09:29:38.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4362025-12-29T09:29:38.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4372025-12-29T09:29:38.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4382025-12-29T09:29:38.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4392025-12-29T09:29:38.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4402025-12-29T09:29:38.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4412025-12-29T09:29:38.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4422025-12-29T09:29:38.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4432025-12-29T09:29:38.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4442025-12-29T09:29:39.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4452025-12-29T09:29:39.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4462025-12-29T09:29:39.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4472025-12-29T09:29:39.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4482025-12-29T09:29:39.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4492025-12-29T09:29:39.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4502025-12-29T09:29:39.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4512025-12-29T09:29:39.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4522025-12-29T09:29:39.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4532025-12-29T09:29:40.321ZDEBGoximeter (results-sink): inserting 220 samples into database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d
4542025-12-29T09:29:40.321ZDEBGoximeter (results-sink-cluster): inserting 220 samples into database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d
4552025-12-29T09:29:40.321ZDEBGoximeter (clickhouse-client): unrolling 220 total samples collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
4562025-12-29T09:29:40.332ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 56 table_name = fields_string
4572025-12-29T09:29:40.334ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 64 table_name = fields_uuid
4582025-12-29T09:29:40.336ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 160 table_name = measurements_cumulativeu64
4592025-12-29T09:29:40.337ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 60 table_name = measurements_u64
4602025-12-29T09:29:40.362ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4612025-12-29T09:29:40.362ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4622025-12-29T09:29:40.362ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4632025-12-29T09:29:40.362ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4642025-12-29T09:29:40.362ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4652025-12-29T09:29:40.362ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4662025-12-29T09:29:40.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4672025-12-29T09:29:40.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4682025-12-29T09:29:40.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4692025-12-29T09:29:40.422ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
4702025-12-29T09:29:41.341ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
4712025-12-29T09:29:41.342ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/9f715b7c-ddc5-4985-995d-18df85af22a1/producers?sort_by=id_ascending
4722025-12-29T09:29:41.344ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/9f715b7c-ddc5-4985-995d-18df85af22a1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4e0bf9d-a973-4646-bdf4-2236511ab1c4", "content-length": "1136", "date": "Mon, 29 Dec 2025 09:29:41 GMT"} })
4732025-12-29T09:29:41.344ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/9f715b7c-ddc5-4985-995d-18df85af22a1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNmM2NjQ4Ni1mYjdkLTQxNzgtODk2NS1kODUwMDBjNWU0MjUifX0%3D
4742025-12-29T09:29:41.347ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/9f715b7c-ddc5-4985-995d-18df85af22a1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNmM2NjQ4Ni1mYjdkLTQxNzgtODk2NS1kODUwMDBjNWU0MjUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "025b183c-4f0e-490d-ab64-99eb2323fb7a", "content-length": "29", "date": "Mon, 29 Dec 2025 09:29:41 GMT"} })
4752025-12-29T09:29:41.347ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:61581 collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5ad709b7-7964-46d0-9560-9029a1172d9f
4762025-12-29T09:29:41.347ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 7 n_pruned_tasks = 0
4772025-12-29T09:29:41.348ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5ad709b7-7964-46d0-9560-9029a1172d9f producer_ip = fd00:1122:3344:101::1 producer_port = 61581
4782025-12-29T09:29:41.348ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5ad709b7-7964-46d0-9560-9029a1172d9f producer_ip = fd00:1122:3344:101::1 producer_port = 61581
4792025-12-29T09:29:41.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = dc6ec0ed-77d4-47c3-86be-8b195e9e3ac6 producer_ip = fd00:1122:3344:101::2 producer_port = 60641
4802025-12-29T09:29:41.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4812025-12-29T09:29:41.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4822025-12-29T09:29:41.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4832025-12-29T09:29:41.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = dc6ec0ed-77d4-47c3-86be-8b195e9e3ac6 producer_ip = fd00:1122:3344:101::2 producer_port = 60641
4842025-12-29T09:29:41.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4852025-12-29T09:29:41.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = a5bdd775-0d59-4c97-ae3d-926939837c7a producer_ip = fd00:1122:3344:101::2 producer_port = 61478
4862025-12-29T09:29:41.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 88cdb129-37c2-4c90-ac1d-c3d882f3801e producer_ip = fd00:1122:3344:101::b producer_port = 65313
4872025-12-29T09:29:41.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = a5bdd775-0d59-4c97-ae3d-926939837c7a producer_ip = fd00:1122:3344:101::2 producer_port = 61478
4882025-12-29T09:29:41.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4892025-12-29T09:29:41.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 88cdb129-37c2-4c90-ac1d-c3d882f3801e producer_ip = fd00:1122:3344:101::b producer_port = 65313
4902025-12-29T09:29:41.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4912025-12-29T09:29:41.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4922025-12-29T09:29:41.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4932025-12-29T09:29:41.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = a5bdd775-0d59-4c97-ae3d-926939837c7a producer_ip = fd00:1122:3344:101::2 producer_port = 61478
4942025-12-29T09:29:41.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = dc6ec0ed-77d4-47c3-86be-8b195e9e3ac6 producer_ip = fd00:1122:3344:101::2 producer_port = 60641
4952025-12-29T09:29:41.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4962025-12-29T09:29:41.366ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 88cdb129-37c2-4c90-ac1d-c3d882f3801e producer_ip = fd00:1122:3344:101::b producer_port = 65313
4972025-12-29T09:29:41.381ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5ad709b7-7964-46d0-9560-9029a1172d9f producer_ip = fd00:1122:3344:101::1 producer_port = 61581
4982025-12-29T09:29:41.491ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5ad709b7-7964-46d0-9560-9029a1172d9f producer_ip = fd00:1122:3344:101::1 producer_port = 61581
4992025-12-29T09:29:41.499ZDEBGoximeter (results-sink-cluster): inserting 2248 samples into database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d
5002025-12-29T09:29:41.499ZDEBGoximeter (results-sink): inserting 2248 samples into database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d
5012025-12-29T09:29:41.499ZDEBGoximeter (clickhouse-client): unrolling 2248 total samples collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
5022025-12-29T09:29:41.506ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
5032025-12-29T09:29:41.532ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:41.506680578Z } timeseries_name = sled_data_link:errors_received
5042025-12-29T09:29:41.532ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
5052025-12-29T09:29:41.533ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:41.532340037Z } timeseries_name = sled_data_link:errors_sent
5062025-12-29T09:29:41.534ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
5072025-12-29T09:29:41.535ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:41.534033907Z } timeseries_name = sled_data_link:bytes_received
5082025-12-29T09:29:41.535ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
5092025-12-29T09:29:41.536ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:41.535447642Z } timeseries_name = sled_data_link:packets_received
5102025-12-29T09:29:41.536ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
5112025-12-29T09:29:41.538ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:41.536846596Z } timeseries_name = sled_data_link:bytes_sent
5122025-12-29T09:29:41.538ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
5132025-12-29T09:29:41.540ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-12-29T09:29:41.538577297Z } timeseries_name = sled_data_link:packets_sent
5142025-12-29T09:29:41.601ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
5152025-12-29T09:29:41.618ZDEBGoximeter (clickhouse-client): inserting 6 new timeseries schema collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
5162025-12-29T09:29:41.621ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 24 table_name = fields_i16
5172025-12-29T09:29:41.622ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 2 table_name = fields_ipaddr
5182025-12-29T09:29:41.624ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 1387 table_name = fields_string
5192025-12-29T09:29:41.626ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 49 table_name = fields_u16
5202025-12-29T09:29:41.627ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 252 table_name = fields_u32
5212025-12-29T09:29:41.629ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 12 table_name = fields_u8
5222025-12-29T09:29:41.630ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 593 table_name = fields_uuid
5232025-12-29T09:29:41.632ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 2189 table_name = measurements_cumulativeu64
5242025-12-29T09:29:41.634ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 35 table_name = measurements_histogramu64
5252025-12-29T09:29:41.636ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 24 table_name = measurements_u64
5262025-12-29T09:29:42.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5272025-12-29T09:29:42.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5282025-12-29T09:29:42.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5292025-12-29T09:29:42.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5302025-12-29T09:29:42.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5312025-12-29T09:29:42.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5322025-12-29T09:29:42.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5332025-12-29T09:29:42.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5342025-12-29T09:29:42.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5352025-12-29T09:29:43.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5362025-12-29T09:29:43.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5372025-12-29T09:29:43.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5382025-12-29T09:29:43.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5392025-12-29T09:29:43.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5402025-12-29T09:29:43.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5412025-12-29T09:29:43.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5422025-12-29T09:29:43.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5432025-12-29T09:29:43.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5442025-12-29T09:29:44.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5452025-12-29T09:29:44.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5462025-12-29T09:29:44.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5472025-12-29T09:29:44.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5482025-12-29T09:29:44.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5492025-12-29T09:29:44.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5502025-12-29T09:29:44.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5512025-12-29T09:29:44.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5522025-12-29T09:29:44.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5532025-12-29T09:29:45.321ZDEBGoximeter (results-sink): inserting 132 samples into database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d
5542025-12-29T09:29:45.321ZDEBGoximeter (results-sink-cluster): inserting 132 samples into database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d
5552025-12-29T09:29:45.321ZDEBGoximeter (clickhouse-client): unrolling 132 total samples collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
5562025-12-29T09:29:45.328ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 56 table_name = fields_string
5572025-12-29T09:29:45.330ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 64 table_name = fields_uuid
5582025-12-29T09:29:45.331ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 96 table_name = measurements_cumulativeu64
5592025-12-29T09:29:45.332ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 36 table_name = measurements_u64
5602025-12-29T09:29:45.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5612025-12-29T09:29:45.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5622025-12-29T09:29:45.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5632025-12-29T09:29:45.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5642025-12-29T09:29:45.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5652025-12-29T09:29:45.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5662025-12-29T09:29:45.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5672025-12-29T09:29:45.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5682025-12-29T09:29:45.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5692025-12-29T09:29:45.422ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
5702025-12-29T09:29:46.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5712025-12-29T09:29:46.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5722025-12-29T09:29:46.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5732025-12-29T09:29:46.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5742025-12-29T09:29:46.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5752025-12-29T09:29:46.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5762025-12-29T09:29:46.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5772025-12-29T09:29:46.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5782025-12-29T09:29:46.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5792025-12-29T09:29:47.362ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5802025-12-29T09:29:47.362ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5812025-12-29T09:29:47.362ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5822025-12-29T09:29:47.362ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5832025-12-29T09:29:47.362ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5842025-12-29T09:29:47.362ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5852025-12-29T09:29:47.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5862025-12-29T09:29:47.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5872025-12-29T09:29:47.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5882025-12-29T09:29:48.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5892025-12-29T09:29:48.362ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5902025-12-29T09:29:48.362ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5912025-12-29T09:29:48.362ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5922025-12-29T09:29:48.362ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5932025-12-29T09:29:48.362ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5942025-12-29T09:29:48.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5952025-12-29T09:29:48.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5962025-12-29T09:29:48.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5972025-12-29T09:29:49.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5982025-12-29T09:29:49.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5992025-12-29T09:29:49.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6002025-12-29T09:29:49.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6012025-12-29T09:29:49.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6022025-12-29T09:29:49.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6032025-12-29T09:29:49.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6042025-12-29T09:29:49.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6052025-12-29T09:29:49.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6062025-12-29T09:29:50.321ZDEBGoximeter (results-sink): inserting 220 samples into database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d
6072025-12-29T09:29:50.321ZDEBGoximeter (results-sink-cluster): inserting 220 samples into database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d
6082025-12-29T09:29:50.321ZDEBGoximeter (clickhouse-client): unrolling 220 total samples collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
6092025-12-29T09:29:50.331ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 56 table_name = fields_string
6102025-12-29T09:29:50.332ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 64 table_name = fields_uuid
6112025-12-29T09:29:50.334ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 160 table_name = measurements_cumulativeu64
6122025-12-29T09:29:50.335ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 60 table_name = measurements_u64
6132025-12-29T09:29:50.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6142025-12-29T09:29:50.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6152025-12-29T09:29:50.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6162025-12-29T09:29:50.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6172025-12-29T09:29:50.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6182025-12-29T09:29:50.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6192025-12-29T09:29:50.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6202025-12-29T09:29:50.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6212025-12-29T09:29:50.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6222025-12-29T09:29:50.422ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
6232025-12-29T09:29:51.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = a5bdd775-0d59-4c97-ae3d-926939837c7a producer_ip = fd00:1122:3344:101::2 producer_port = 61478
6242025-12-29T09:29:51.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6252025-12-29T09:29:51.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = a5bdd775-0d59-4c97-ae3d-926939837c7a producer_ip = fd00:1122:3344:101::2 producer_port = 61478
6262025-12-29T09:29:51.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6272025-12-29T09:29:51.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 88cdb129-37c2-4c90-ac1d-c3d882f3801e producer_ip = fd00:1122:3344:101::b producer_port = 65313
6282025-12-29T09:29:51.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6292025-12-29T09:29:51.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6302025-12-29T09:29:51.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6312025-12-29T09:29:51.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 88cdb129-37c2-4c90-ac1d-c3d882f3801e producer_ip = fd00:1122:3344:101::b producer_port = 65313
6322025-12-29T09:29:51.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6332025-12-29T09:29:51.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6342025-12-29T09:29:51.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6352025-12-29T09:29:51.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = a5bdd775-0d59-4c97-ae3d-926939837c7a producer_ip = fd00:1122:3344:101::2 producer_port = 61478
6362025-12-29T09:29:51.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6372025-12-29T09:29:51.365ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 88cdb129-37c2-4c90-ac1d-c3d882f3801e producer_ip = fd00:1122:3344:101::b producer_port = 65313
6382025-12-29T09:29:52.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6392025-12-29T09:29:52.362ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6402025-12-29T09:29:52.362ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6412025-12-29T09:29:52.362ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6422025-12-29T09:29:52.362ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6432025-12-29T09:29:52.362ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6442025-12-29T09:29:52.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6452025-12-29T09:29:52.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6462025-12-29T09:29:52.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6472025-12-29T09:29:53.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6482025-12-29T09:29:53.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6492025-12-29T09:29:53.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6502025-12-29T09:29:53.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6512025-12-29T09:29:53.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6522025-12-29T09:29:53.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6532025-12-29T09:29:53.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6542025-12-29T09:29:53.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6552025-12-29T09:29:53.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6562025-12-29T09:29:54.362ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6572025-12-29T09:29:54.362ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6582025-12-29T09:29:54.362ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6592025-12-29T09:29:54.362ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6602025-12-29T09:29:54.362ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6612025-12-29T09:29:54.362ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6622025-12-29T09:29:54.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6632025-12-29T09:29:54.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6642025-12-29T09:29:54.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6652025-12-29T09:29:55.322ZDEBGoximeter (results-sink): inserting 255 samples into database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d
6662025-12-29T09:29:55.322ZDEBGoximeter (results-sink-cluster): inserting 255 samples into database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d
6672025-12-29T09:29:55.322ZDEBGoximeter (clickhouse-client): unrolling 255 total samples collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
6682025-12-29T09:29:55.334ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 126 table_name = fields_string
6692025-12-29T09:29:55.336ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 35 table_name = fields_u16
6702025-12-29T09:29:55.337ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 99 table_name = fields_uuid
6712025-12-29T09:29:55.338ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 160 table_name = measurements_cumulativeu64
6722025-12-29T09:29:55.340ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 35 table_name = measurements_histogramu64
6732025-12-29T09:29:55.342ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 60 table_name = measurements_u64
6742025-12-29T09:29:55.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6752025-12-29T09:29:55.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6762025-12-29T09:29:55.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6772025-12-29T09:29:55.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6782025-12-29T09:29:55.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6792025-12-29T09:29:55.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6802025-12-29T09:29:55.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6812025-12-29T09:29:55.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6822025-12-29T09:29:55.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6832025-12-29T09:29:55.423ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
6842025-12-29T09:29:56.342ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
6852025-12-29T09:29:56.342ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/9f715b7c-ddc5-4985-995d-18df85af22a1/producers?sort_by=id_ascending
6862025-12-29T09:29:56.345ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/9f715b7c-ddc5-4985-995d-18df85af22a1/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "2685ea27-bfcc-45e3-8687-fb1c8112369c", "content-length": "1136", "date": "Mon, 29 Dec 2025 09:29:56 GMT"} })
6872025-12-29T09:29:56.345ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/9f715b7c-ddc5-4985-995d-18df85af22a1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNmM2NjQ4Ni1mYjdkLTQxNzgtODk2NS1kODUwMDBjNWU0MjUifX0%3D
6882025-12-29T09:29:56.348ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/9f715b7c-ddc5-4985-995d-18df85af22a1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNmM2NjQ4Ni1mYjdkLTQxNzgtODk2NS1kODUwMDBjNWU0MjUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "6eccbfd6-87ee-4f44-8f6b-293d5bbebd1e", "content-length": "29", "date": "Mon, 29 Dec 2025 09:29:56 GMT"} })
6892025-12-29T09:29:56.348ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 7 n_pruned_tasks = 0
6902025-12-29T09:29:56.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6912025-12-29T09:29:56.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6922025-12-29T09:29:56.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6932025-12-29T09:29:56.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6942025-12-29T09:29:56.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6952025-12-29T09:29:56.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6962025-12-29T09:29:56.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6972025-12-29T09:29:56.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6982025-12-29T09:29:56.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6992025-12-29T09:29:57.362ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7002025-12-29T09:29:57.362ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7012025-12-29T09:29:57.362ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7022025-12-29T09:29:57.362ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7032025-12-29T09:29:57.362ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7042025-12-29T09:29:57.362ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7052025-12-29T09:29:57.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7062025-12-29T09:29:57.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7072025-12-29T09:29:57.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7082025-12-29T09:29:58.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7092025-12-29T09:29:58.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7102025-12-29T09:29:58.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7112025-12-29T09:29:58.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7122025-12-29T09:29:58.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7132025-12-29T09:29:58.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7142025-12-29T09:29:58.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7152025-12-29T09:29:58.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7162025-12-29T09:29:58.364ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7172025-12-29T09:29:59.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7182025-12-29T09:29:59.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7192025-12-29T09:29:59.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7202025-12-29T09:29:59.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7212025-12-29T09:29:59.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7222025-12-29T09:29:59.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7232025-12-29T09:29:59.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7242025-12-29T09:29:59.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7252025-12-29T09:29:59.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7262025-12-29T09:30:00.321ZDEBGoximeter (results-sink): inserting 220 samples into database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d
7272025-12-29T09:30:00.321ZDEBGoximeter (results-sink-cluster): inserting 220 samples into database collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d
7282025-12-29T09:30:00.321ZDEBGoximeter (clickhouse-client): unrolling 220 total samples collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa
7292025-12-29T09:30:00.332ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 56 table_name = fields_string
7302025-12-29T09:30:00.334ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 64 table_name = fields_uuid
7312025-12-29T09:30:00.335ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 160 table_name = measurements_cumulativeu64
7322025-12-29T09:30:00.337ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d id = 66fb339f-745c-4217-8188-a7bb2b0376aa n_rows = 60 table_name = measurements_u64
7332025-12-29T09:30:00.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7342025-12-29T09:30:00.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7352025-12-29T09:30:00.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7362025-12-29T09:30:00.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7372025-12-29T09:30:00.361ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7382025-12-29T09:30:00.361ZDEBGoximeter (collection-task): collecting from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7392025-12-29T09:30:00.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 2ec96b97-66a8-4f8b-a0b5-1416a56b11ae producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7402025-12-29T09:30:00.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f6c66486-fb7d-4178-8965-d85000c5e425 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7412025-12-29T09:30:00.363ZDEBGoximeter (collection-task): collected results from producer collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 5974d0f3-2c3d-4ba2-b930-52ddfd34f511 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7422025-12-29T09:30:00.423ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 9f715b7c-ddc5-4985-995d-18df85af22a1 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92