Max level shown:
1 [ Nov 5 23:29:06 Enabled. ]
2 [ Nov 5 23:29:06 Rereading configuration. ]
3 [ Nov 5 23:29:08 Rereading configuration. ]
4 [ Nov 5 23:29:19 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id b3eeb16e-377f-46cb-afce-39da7334e727 &"). ]
5 [ Nov 5 23:29:19 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72025-11-05T23:29:19.485ZDEBGoximeter: registered DTrace probes
82025-11-05T23:29:19.492ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:264
92025-11-05T23:29:19.494ZDEBGoximeter: creating ClickHouse client
102025-11-05T23:29:19.508ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
112025-11-05T23:29:24.336ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:900 id = fe03af7a-5b4d-44bf-882b-024d48db185e
122025-11-05T23:29:24.336ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d
132025-11-05T23:29:24.336ZINFOoximeter (clickhouse-client): reading db version collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:800 id = fe03af7a-5b4d-44bf-882b-024d48db185e
142025-11-05T23:29:24.338ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:900 id = fe03af7a-5b4d-44bf-882b-024d48db185e
152025-11-05T23:29:24.338ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:805 id = fe03af7a-5b4d-44bf-882b-024d48db185e version = 0
162025-11-05T23:29:24.338ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:810 id = fe03af7a-5b4d-44bf-882b-024d48db185e
172025-11-05T23:29:24.338ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
182025-11-05T23:29:24.665ZINFOoximeter (clickhouse-client): inserting current version collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:831 id = fe03af7a-5b4d-44bf-882b-024d48db185e version = 14
192025-11-05T23:29:24.704ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = a598469b-508d-49aa-8f67-b7c0ac76e41f
202025-11-05T23:29:24.731ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212025-11-05T23:29:24.732ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222025-11-05T23:29:24.732ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232025-11-05T23:29:24.732ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242025-11-05T23:29:24.732ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.4/src/server.rs:328 local_addr = [fd00:1122:3344:101::d]:12223
252025-11-05T23:29:24.732ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262025-11-05T23:29:24.732ZDEBGoximeter: registered USDT probes
272025-11-05T23:29:24.732ZDEBGoximeter: contacting nexus
282025-11-05T23:29:24.916ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
292025-11-05T23:29:24.921ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
302025-11-05T23:29:24.921ZWARNoximeter: failed to contact nexus, will retry in 179.126288ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:409
312025-11-05T23:29:25.100ZDEBGoximeter: contacting nexus
322025-11-05T23:29:25.100ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
332025-11-05T23:29:25.101ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::c]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
342025-11-05T23:29:25.101ZWARNoximeter: failed to contact nexus, will retry in 303.200604ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:409
352025-11-05T23:29:25.405ZDEBGoximeter: contacting nexus
362025-11-05T23:29:25.405ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
372025-11-05T23:29:25.405ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::c]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
382025-11-05T23:29:25.405ZWARNoximeter: failed to contact nexus, will retry in 1.082372723s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:409
392025-11-05T23:29:26.488ZDEBGoximeter: contacting nexus
402025-11-05T23:29:26.489ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
412025-11-05T23:29:26.611ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "a0928445-e498-4346-b2a5-7e9883a16fca", "date": "Wed, 05 Nov 2025 23:29:26 GMT"} })
422025-11-05T23:29:26.613ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:427 id = b3eeb16e-377f-46cb-afce-39da7334e727
432025-11-05T23:29:26.613ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:554
442025-11-05T23:29:26.614ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
452025-11-05T23:29:26.624ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/b3eeb16e-377f-46cb-afce-39da7334e727/producers?sort_by=id_ascending
462025-11-05T23:29:26.682ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/b3eeb16e-377f-46cb-afce-39da7334e727/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "93974574-b6fb-4fb0-b8ef-0496a22a8d75", "content-length": "29", "date": "Wed, 05 Nov 2025 23:29:26 GMT"} })
472025-11-05T23:29:26.682ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 0 n_pruned_tasks = 0
482025-11-05T23:29:41.614ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
492025-11-05T23:29:41.614ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/b3eeb16e-377f-46cb-afce-39da7334e727/producers?sort_by=id_ascending
502025-11-05T23:29:41.640ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/b3eeb16e-377f-46cb-afce-39da7334e727/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "c52f8c0b-b1eb-44e1-8456-89a5eac5fb7d", "content-length": "857", "date": "Wed, 05 Nov 2025 23:29:41 GMT"} })
512025-11-05T23:29:41.642ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/b3eeb16e-377f-46cb-afce-39da7334e727/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZDJjNGM1ZC01ODc2LTRkZTYtOGYwOC0wNWZhMTI2YTYwOTkifX0%3D
522025-11-05T23:29:41.645ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/b3eeb16e-377f-46cb-afce-39da7334e727/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZDJjNGM1ZC01ODc2LTRkZTYtOGYwOC0wNWZhMTI2YTYwOTkifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf7beef4-2020-41ea-925b-b83991e1484e", "content-length": "29", "date": "Wed, 05 Nov 2025 23:29:41 GMT"} })
532025-11-05T23:29:41.645ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:34029 collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 0554e433-a03c-41cc-a3fa-4e52e20baa91
542025-11-05T23:29:41.645ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:36695 collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 13ae660c-a6d6-4a11-bf5c-4a2b7164a4e8
552025-11-05T23:29:41.645ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
562025-11-05T23:29:41.645ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
572025-11-05T23:29:41.645ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
582025-11-05T23:29:41.645ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 5 n_pruned_tasks = 0
592025-11-05T23:29:41.647ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
602025-11-05T23:29:41.647ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 0554e433-a03c-41cc-a3fa-4e52e20baa91
612025-11-05T23:29:41.647ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 13ae660c-a6d6-4a11-bf5c-4a2b7164a4e8
622025-11-05T23:29:41.647ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
632025-11-05T23:29:41.647ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
642025-11-05T23:29:41.693ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
652025-11-05T23:29:41.693ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
662025-11-05T23:29:41.693ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
672025-11-05T23:29:41.693ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 13ae660c-a6d6-4a11-bf5c-4a2b7164a4e8
682025-11-05T23:29:41.693ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 0554e433-a03c-41cc-a3fa-4e52e20baa91
692025-11-05T23:29:41.810ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
702025-11-05T23:29:41.828ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
712025-11-05T23:29:41.843ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 0554e433-a03c-41cc-a3fa-4e52e20baa91
722025-11-05T23:29:41.879ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0554e433-a03c-41cc-a3fa-4e52e20baa91
732025-11-05T23:29:41.995ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
742025-11-05T23:29:42.007ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
752025-11-05T23:29:42.007ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 13ae660c-a6d6-4a11-bf5c-4a2b7164a4e8
762025-11-05T23:29:42.013ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
772025-11-05T23:29:42.016ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
782025-11-05T23:29:42.023ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 13ae660c-a6d6-4a11-bf5c-4a2b7164a4e8
792025-11-05T23:29:42.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
802025-11-05T23:29:42.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
812025-11-05T23:29:42.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
822025-11-05T23:29:42.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
832025-11-05T23:29:42.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
842025-11-05T23:29:42.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
852025-11-05T23:29:42.647ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
862025-11-05T23:29:42.649ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
872025-11-05T23:29:42.649ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
882025-11-05T23:29:43.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
892025-11-05T23:29:43.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
902025-11-05T23:29:43.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
912025-11-05T23:29:43.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
922025-11-05T23:29:43.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
932025-11-05T23:29:43.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
942025-11-05T23:29:43.647ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
952025-11-05T23:29:43.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
962025-11-05T23:29:43.649ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
972025-11-05T23:29:44.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
982025-11-05T23:29:44.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
992025-11-05T23:29:44.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
1002025-11-05T23:29:44.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
1012025-11-05T23:29:44.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
1022025-11-05T23:29:44.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
1032025-11-05T23:29:44.647ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
1042025-11-05T23:29:44.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
1052025-11-05T23:29:44.649ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
1062025-11-05T23:29:44.705ZDEBGoximeter (results-sink): inserting 397 samples into database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d
1072025-11-05T23:29:44.705ZDEBGoximeter (results-sink-cluster): inserting 397 samples into database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d
1082025-11-05T23:29:44.705ZDEBGoximeter (clickhouse-client): unrolling 397 total samples collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1092025-11-05T23:29:44.712ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1102025-11-05T23:29:44.738ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.712605142Z } timeseries_name = oximeter_collector:collections
1112025-11-05T23:29:44.746ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1122025-11-05T23:29:44.757ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.746001505Z } timeseries_name = static_routing_config:static_routes
1132025-11-05T23:29:44.757ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1142025-11-05T23:29:44.763ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.757849968Z } timeseries_name = static_routing_config:static_nexthops
1152025-11-05T23:29:44.763ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1162025-11-05T23:29:44.764ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.763467342Z } timeseries_name = switch_rib:active_routes
1172025-11-05T23:29:44.764ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1182025-11-05T23:29:44.765ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.764521471Z } timeseries_name = mg_lower:routes_blocked_by_link_state
1192025-11-05T23:29:44.765ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1202025-11-05T23:29:44.766ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.765441586Z } timeseries_name = switch_data_link:link_enabled
1212025-11-05T23:29:44.768ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1222025-11-05T23:29:44.769ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.768777297Z } timeseries_name = switch_data_link:link_up
1232025-11-05T23:29:44.770ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1242025-11-05T23:29:44.770ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.770075542Z } timeseries_name = switch_table:capacity
1252025-11-05T23:29:44.770ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1262025-11-05T23:29:44.771ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.770990478Z } timeseries_name = switch_table:occupancy
1272025-11-05T23:29:44.771ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1282025-11-05T23:29:44.772ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.771950514Z } timeseries_name = switch_table:inserts
1292025-11-05T23:29:44.772ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1302025-11-05T23:29:44.773ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.772901790Z } timeseries_name = switch_table:deletes
1312025-11-05T23:29:44.773ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1322025-11-05T23:29:44.774ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.773810644Z } timeseries_name = switch_table:updates
1332025-11-05T23:29:44.774ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1342025-11-05T23:29:44.775ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.774759581Z } timeseries_name = switch_table:collisions
1352025-11-05T23:29:44.775ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1362025-11-05T23:29:44.776ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.775680346Z } timeseries_name = switch_table:update_misses
1372025-11-05T23:29:44.776ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1382025-11-05T23:29:44.777ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.776603951Z } timeseries_name = switch_table:delete_misses
1392025-11-05T23:29:44.777ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1402025-11-05T23:29:44.778ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.777532976Z } timeseries_name = switch_table:exhaustion
1412025-11-05T23:29:44.789ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1422025-11-05T23:29:44.791ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.789867453Z } timeseries_name = dendrite:sample_collection_duration
1432025-11-05T23:29:44.791ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1442025-11-05T23:29:44.792ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.791540189Z } timeseries_name = ddm_router:originated_underlay_prefixes
1452025-11-05T23:29:44.792ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1462025-11-05T23:29:44.793ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.792474414Z } timeseries_name = ddm_router:originated_tunnel_endpoints
1472025-11-05T23:29:44.793ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1482025-11-05T23:29:44.794ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.793389999Z } timeseries_name = ddm_session:solicitations_sent
1492025-11-05T23:29:44.794ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1502025-11-05T23:29:44.795ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.794332795Z } timeseries_name = ddm_session:solicitations_received
1512025-11-05T23:29:44.795ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1522025-11-05T23:29:44.796ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.795271321Z } timeseries_name = ddm_session:advertisements_sent
1532025-11-05T23:29:44.796ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1542025-11-05T23:29:44.797ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.796202416Z } timeseries_name = ddm_session:advertisements_received
1552025-11-05T23:29:44.797ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1562025-11-05T23:29:44.798ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.797130202Z } timeseries_name = ddm_session:peer_expirations
1572025-11-05T23:29:44.798ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1582025-11-05T23:29:44.798ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.798058967Z } timeseries_name = ddm_session:peer_address_changes
1592025-11-05T23:29:44.798ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1602025-11-05T23:29:44.799ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.798976142Z } timeseries_name = ddm_session:peer_sessions_established
1612025-11-05T23:29:44.799ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1622025-11-05T23:29:44.800ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.799910188Z } timeseries_name = ddm_session:updates_sent
1632025-11-05T23:29:44.800ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1642025-11-05T23:29:44.801ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.800845543Z } timeseries_name = ddm_session:updates_received
1652025-11-05T23:29:44.801ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1662025-11-05T23:29:44.802ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.801780919Z } timeseries_name = ddm_session:update_send_fail
1672025-11-05T23:29:44.802ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1682025-11-05T23:29:44.803ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.802736365Z } timeseries_name = ddm_session:imported_underlay_prefixes
1692025-11-05T23:29:44.803ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1702025-11-05T23:29:44.804ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.803694501Z } timeseries_name = ddm_session:imported_tunnel_endpoints
1712025-11-05T23:29:44.805ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1722025-11-05T23:29:44.806ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:44.805687115Z } timeseries_name = http_service:request_latency_histogram
1732025-11-05T23:29:44.807ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
1742025-11-05T23:29:44.813ZDEBGoximeter (clickhouse-client): inserting 32 new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
1752025-11-05T23:29:44.824ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 410 table_name = fields_i16
1762025-11-05T23:29:44.827ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 10 table_name = fields_ipaddr
1772025-11-05T23:29:44.829ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 1139 table_name = fields_string
1782025-11-05T23:29:44.831ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 226 table_name = fields_u16
1792025-11-05T23:29:44.833ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 212 table_name = fields_u32
1802025-11-05T23:29:44.835ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 211 table_name = fields_u8
1812025-11-05T23:29:44.837ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 700 table_name = fields_uuid
1822025-11-05T23:29:44.839ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 6 table_name = measurements_bool
1832025-11-05T23:29:44.843ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 287 table_name = measurements_cumulativeu64
1842025-11-05T23:29:44.845ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 1 table_name = measurements_f64
1852025-11-05T23:29:44.851ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 11 table_name = measurements_histogramu64
1862025-11-05T23:29:44.853ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 92 table_name = measurements_u64
1872025-11-05T23:29:45.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
1882025-11-05T23:29:45.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
1892025-11-05T23:29:45.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
1902025-11-05T23:29:45.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
1912025-11-05T23:29:45.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
1922025-11-05T23:29:45.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
1932025-11-05T23:29:45.647ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
1942025-11-05T23:29:45.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
1952025-11-05T23:29:45.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
1962025-11-05T23:29:46.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
1972025-11-05T23:29:46.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
1982025-11-05T23:29:46.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
1992025-11-05T23:29:46.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2002025-11-05T23:29:46.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2012025-11-05T23:29:46.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2022025-11-05T23:29:46.647ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2032025-11-05T23:29:46.647ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2042025-11-05T23:29:46.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2052025-11-05T23:29:47.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2062025-11-05T23:29:47.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2072025-11-05T23:29:47.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2082025-11-05T23:29:47.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2092025-11-05T23:29:47.647ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2102025-11-05T23:29:47.647ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2112025-11-05T23:29:47.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2122025-11-05T23:29:47.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2132025-11-05T23:29:47.649ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2142025-11-05T23:29:48.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2152025-11-05T23:29:48.647ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2162025-11-05T23:29:48.647ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2172025-11-05T23:29:48.647ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2182025-11-05T23:29:48.647ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2192025-11-05T23:29:48.647ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2202025-11-05T23:29:48.647ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2212025-11-05T23:29:48.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2222025-11-05T23:29:48.649ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2232025-11-05T23:29:49.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2242025-11-05T23:29:49.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2252025-11-05T23:29:49.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2262025-11-05T23:29:49.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2272025-11-05T23:29:49.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2282025-11-05T23:29:49.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2292025-11-05T23:29:49.647ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2302025-11-05T23:29:49.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2312025-11-05T23:29:49.649ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2322025-11-05T23:29:49.705ZDEBGoximeter (results-sink-cluster): inserting 220 samples into database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d
2332025-11-05T23:29:49.705ZDEBGoximeter (results-sink): inserting 220 samples into database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d
2342025-11-05T23:29:49.705ZDEBGoximeter (clickhouse-client): unrolling 220 total samples collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
2352025-11-05T23:29:49.716ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 56 table_name = fields_string
2362025-11-05T23:29:49.718ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 64 table_name = fields_uuid
2372025-11-05T23:29:49.720ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 160 table_name = measurements_cumulativeu64
2382025-11-05T23:29:49.721ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 60 table_name = measurements_u64
2392025-11-05T23:29:49.806ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
2402025-11-05T23:29:50.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2412025-11-05T23:29:50.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2422025-11-05T23:29:50.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2432025-11-05T23:29:50.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2442025-11-05T23:29:50.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2452025-11-05T23:29:50.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2462025-11-05T23:29:50.647ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2472025-11-05T23:29:50.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2482025-11-05T23:29:50.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2492025-11-05T23:29:51.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 13ae660c-a6d6-4a11-bf5c-4a2b7164a4e8
2502025-11-05T23:29:51.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2512025-11-05T23:29:51.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 13ae660c-a6d6-4a11-bf5c-4a2b7164a4e8
2522025-11-05T23:29:51.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2532025-11-05T23:29:51.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 0554e433-a03c-41cc-a3fa-4e52e20baa91
2542025-11-05T23:29:51.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 0554e433-a03c-41cc-a3fa-4e52e20baa91
2552025-11-05T23:29:51.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2562025-11-05T23:29:51.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2572025-11-05T23:29:51.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2582025-11-05T23:29:51.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2592025-11-05T23:29:51.647ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2602025-11-05T23:29:51.647ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2612025-11-05T23:29:51.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 13ae660c-a6d6-4a11-bf5c-4a2b7164a4e8
2622025-11-05T23:29:51.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2632025-11-05T23:29:51.665ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0554e433-a03c-41cc-a3fa-4e52e20baa91
2642025-11-05T23:29:52.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2652025-11-05T23:29:52.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2662025-11-05T23:29:52.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2672025-11-05T23:29:52.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2682025-11-05T23:29:52.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2692025-11-05T23:29:52.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2702025-11-05T23:29:52.647ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2712025-11-05T23:29:52.647ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2722025-11-05T23:29:52.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2732025-11-05T23:29:53.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2742025-11-05T23:29:53.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2752025-11-05T23:29:53.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2762025-11-05T23:29:53.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2772025-11-05T23:29:53.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2782025-11-05T23:29:53.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2792025-11-05T23:29:53.647ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2802025-11-05T23:29:53.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2812025-11-05T23:29:53.649ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2822025-11-05T23:29:54.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2832025-11-05T23:29:54.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2842025-11-05T23:29:54.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2852025-11-05T23:29:54.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2862025-11-05T23:29:54.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2872025-11-05T23:29:54.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2882025-11-05T23:29:54.647ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
2892025-11-05T23:29:54.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
2902025-11-05T23:29:54.649ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
2912025-11-05T23:29:54.705ZDEBGoximeter (results-sink): inserting 436 samples into database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d
2922025-11-05T23:29:54.705ZDEBGoximeter (results-sink-cluster): inserting 436 samples into database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d
2932025-11-05T23:29:54.705ZDEBGoximeter (clickhouse-client): unrolling 436 total samples collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
2942025-11-05T23:29:54.730ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 410 table_name = fields_i16
2952025-11-05T23:29:54.732ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 1134 table_name = fields_string
2962025-11-05T23:29:54.734ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 216 table_name = fields_u16
2972025-11-05T23:29:54.736ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 212 table_name = fields_u32
2982025-11-05T23:29:54.738ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 211 table_name = fields_u8
2992025-11-05T23:29:54.740ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 690 table_name = fields_uuid
3002025-11-05T23:29:54.741ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 6 table_name = measurements_bool
3012025-11-05T23:29:54.743ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 314 table_name = measurements_cumulativeu64
3022025-11-05T23:29:54.745ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 1 table_name = measurements_f64
3032025-11-05T23:29:54.747ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 11 table_name = measurements_histogramu64
3042025-11-05T23:29:54.749ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 104 table_name = measurements_u64
3052025-11-05T23:29:54.806ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
3062025-11-05T23:29:55.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
3072025-11-05T23:29:55.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
3082025-11-05T23:29:55.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
3092025-11-05T23:29:55.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
3102025-11-05T23:29:55.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
3112025-11-05T23:29:55.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
3122025-11-05T23:29:55.647ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
3132025-11-05T23:29:55.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
3142025-11-05T23:29:55.649ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
3152025-11-05T23:29:56.614ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:557
3162025-11-05T23:29:56.614ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/b3eeb16e-377f-46cb-afce-39da7334e727/producers?sort_by=id_ascending
3172025-11-05T23:29:56.620ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/b3eeb16e-377f-46cb-afce-39da7334e727/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "657df731-35dc-4aa2-bbbb-b4a8dbde5f6e", "content-length": "1136", "date": "Wed, 05 Nov 2025 23:29:56 GMT"} })
3182025-11-05T23:29:56.620ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/b3eeb16e-377f-46cb-afce-39da7334e727/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZDJjNGM1ZC01ODc2LTRkZTYtOGYwOC0wNWZhMTI2YTYwOTkifX0%3D
3192025-11-05T23:29:56.623ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/b3eeb16e-377f-46cb-afce-39da7334e727/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZDJjNGM1ZC01ODc2LTRkZTYtOGYwOC0wNWZhMTI2YTYwOTkifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "00488eab-c415-4def-a0e5-2a468e6dfe59", "content-length": "29", "date": "Wed, 05 Nov 2025 23:29:56 GMT"} })
3202025-11-05T23:29:56.623ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:60061 collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 0ae2a5d1-18e1-41cb-b6a0-df0f7691eb38
3212025-11-05T23:29:56.623ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:46501 collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 0f6a24e9-8798-4a6f-be0a-62e430e251f9
3222025-11-05T23:29:56.623ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:632 n_current_tasks = 7 n_pruned_tasks = 0
3232025-11-05T23:29:56.624ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 0ae2a5d1-18e1-41cb-b6a0-df0f7691eb38
3242025-11-05T23:29:56.624ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 0f6a24e9-8798-4a6f-be0a-62e430e251f9
3252025-11-05T23:29:56.624ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 0ae2a5d1-18e1-41cb-b6a0-df0f7691eb38
3262025-11-05T23:29:56.624ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 0f6a24e9-8798-4a6f-be0a-62e430e251f9
3272025-11-05T23:29:56.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
3282025-11-05T23:29:56.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
3292025-11-05T23:29:56.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
3302025-11-05T23:29:56.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
3312025-11-05T23:29:56.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
3322025-11-05T23:29:56.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
3332025-11-05T23:29:56.647ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
3342025-11-05T23:29:56.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
3352025-11-05T23:29:56.649ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
3362025-11-05T23:29:56.684ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 0ae2a5d1-18e1-41cb-b6a0-df0f7691eb38
3372025-11-05T23:29:56.686ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 0ae2a5d1-18e1-41cb-b6a0-df0f7691eb38
3382025-11-05T23:29:56.687ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 0f6a24e9-8798-4a6f-be0a-62e430e251f9
3392025-11-05T23:29:56.763ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0f6a24e9-8798-4a6f-be0a-62e430e251f9
3402025-11-05T23:29:56.769ZDEBGoximeter (results-sink-cluster): inserting 1590 samples into database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d
3412025-11-05T23:29:56.770ZDEBGoximeter (results-sink): inserting 1590 samples into database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d
3422025-11-05T23:29:56.770ZDEBGoximeter (clickhouse-client): unrolling 1590 total samples collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
3432025-11-05T23:29:56.773ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
3442025-11-05T23:29:56.811ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:56.773925763Z } timeseries_name = collection_target:cpus_provisioned
3452025-11-05T23:29:56.811ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
3462025-11-05T23:29:56.813ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:56.811667734Z } timeseries_name = collection_target:ram_provisioned
3472025-11-05T23:29:56.813ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
3482025-11-05T23:29:56.815ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:56.813847044Z } timeseries_name = collection_target:virtual_disk_space_provisioned
3492025-11-05T23:29:56.815ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
3502025-11-05T23:29:56.817ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:56.815604422Z } timeseries_name = sled_data_link:errors_received
3512025-11-05T23:29:56.817ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
3522025-11-05T23:29:56.819ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:56.817607276Z } timeseries_name = sled_data_link:errors_sent
3532025-11-05T23:29:56.819ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
3542025-11-05T23:29:56.821ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:56.819210020Z } timeseries_name = sled_data_link:bytes_received
3552025-11-05T23:29:56.821ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
3562025-11-05T23:29:56.822ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:56.821171494Z } timeseries_name = sled_data_link:packets_received
3572025-11-05T23:29:56.822ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
3582025-11-05T23:29:56.824ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:56.822666735Z } timeseries_name = sled_data_link:bytes_sent
3592025-11-05T23:29:56.824ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
3602025-11-05T23:29:56.825ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-11-05T23:29:56.824140955Z } timeseries_name = sled_data_link:packets_sent
3612025-11-05T23:29:56.870ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
3622025-11-05T23:29:56.879ZDEBGoximeter (clickhouse-client): inserting 9 new timeseries schema collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
3632025-11-05T23:29:56.884ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 4 table_name = fields_ipaddr
3642025-11-05T23:29:56.886ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 1210 table_name = fields_string
3652025-11-05T23:29:56.888ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 10 table_name = fields_u16
3662025-11-05T23:29:56.890ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 228 table_name = fields_u32
3672025-11-05T23:29:56.892ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 536 table_name = fields_uuid
3682025-11-05T23:29:56.894ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 1554 table_name = measurements_cumulativeu64
3692025-11-05T23:29:56.897ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 6 table_name = measurements_histogramu64
3702025-11-05T23:29:56.898ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 6 table_name = measurements_i64
3712025-11-05T23:29:56.900ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 24 table_name = measurements_u64
3722025-11-05T23:29:57.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
3732025-11-05T23:29:57.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
3742025-11-05T23:29:57.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
3752025-11-05T23:29:57.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
3762025-11-05T23:29:57.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
3772025-11-05T23:29:57.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
3782025-11-05T23:29:57.647ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
3792025-11-05T23:29:57.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
3802025-11-05T23:29:57.649ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
3812025-11-05T23:29:58.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
3822025-11-05T23:29:58.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
3832025-11-05T23:29:58.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
3842025-11-05T23:29:58.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
3852025-11-05T23:29:58.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
3862025-11-05T23:29:58.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
3872025-11-05T23:29:58.647ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
3882025-11-05T23:29:58.647ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
3892025-11-05T23:29:58.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
3902025-11-05T23:29:59.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
3912025-11-05T23:29:59.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
3922025-11-05T23:29:59.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
3932025-11-05T23:29:59.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
3942025-11-05T23:29:59.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
3952025-11-05T23:29:59.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
3962025-11-05T23:29:59.647ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
3972025-11-05T23:29:59.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
3982025-11-05T23:29:59.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
3992025-11-05T23:29:59.705ZDEBGoximeter (results-sink): inserting 132 samples into database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d
4002025-11-05T23:29:59.705ZDEBGoximeter (results-sink-cluster): inserting 132 samples into database collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d
4012025-11-05T23:29:59.705ZDEBGoximeter (clickhouse-client): unrolling 132 total samples collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e
4022025-11-05T23:29:59.713ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 56 table_name = fields_string
4032025-11-05T23:29:59.715ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 64 table_name = fields_uuid
4042025-11-05T23:29:59.717ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 96 table_name = measurements_cumulativeu64
4052025-11-05T23:29:59.719ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d id = fe03af7a-5b4d-44bf-882b-024d48db185e n_rows = 36 table_name = measurements_u64
4062025-11-05T23:29:59.806ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
4072025-11-05T23:30:00.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
4082025-11-05T23:30:00.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
4092025-11-05T23:30:00.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
4102025-11-05T23:30:00.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
4112025-11-05T23:30:00.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
4122025-11-05T23:30:00.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
4132025-11-05T23:30:00.647ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
4142025-11-05T23:30:00.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
4152025-11-05T23:30:00.649ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
4162025-11-05T23:30:01.645ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 13ae660c-a6d6-4a11-bf5c-4a2b7164a4e8
4172025-11-05T23:30:01.645ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
4182025-11-05T23:30:01.645ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
4192025-11-05T23:30:01.645ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
4202025-11-05T23:30:01.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 0554e433-a03c-41cc-a3fa-4e52e20baa91
4212025-11-05T23:30:01.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 13ae660c-a6d6-4a11-bf5c-4a2b7164a4e8
4222025-11-05T23:30:01.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = 0554e433-a03c-41cc-a3fa-4e52e20baa91
4232025-11-05T23:30:01.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
4242025-11-05T23:30:01.646ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
4252025-11-05T23:30:01.646ZDEBGoximeter (collection-task): collecting from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
4262025-11-05T23:30:01.646ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = a1c2d743-e735-40c0-af0d-f2fc4b7b538c
4272025-11-05T23:30:01.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = cd2c4c5d-5876-4de6-8f08-05fa126a6099
4282025-11-05T23:30:01.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 13ae660c-a6d6-4a11-bf5c-4a2b7164a4e8
4292025-11-05T23:30:01.648ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 8e1efaa1-e000-4544-a691-38996a94607a
4302025-11-05T23:30:01.665ZDEBGoximeter (collection-task): collected results from producer collector_id = b3eeb16e-377f-46cb-afce-39da7334e727 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 0554e433-a03c-41cc-a3fa-4e52e20baa91