Max level shown:
1 [ Apr 29 23:14:17 Enabled. ]
2 [ Apr 29 23:14:17 Rereading configuration. ]
3 [ Apr 29 23:14:18 Rereading configuration. ]
4 [ Apr 29 23:14:22 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 &"). ]
5 [ Apr 29 23:14:22 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-04-29T23:14:22.685ZDEBGoximeter: registered DTrace probes
82026-04-29T23:14:22.707ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:301
92026-04-29T23:14:22.712ZDEBGoximeter: creating ClickHouse client
102026-04-29T23:14:22.741ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90
112026-04-29T23:14:31.072ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:882 id = dcdf06da-b459-49b5-a63a-2f5501d23d90
122026-04-29T23:14:31.072ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d
132026-04-29T23:14:31.072ZINFOoximeter (clickhouse-client): reading db version collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:782 id = dcdf06da-b459-49b5-a63a-2f5501d23d90
142026-04-29T23:14:31.073ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:882 id = dcdf06da-b459-49b5-a63a-2f5501d23d90
152026-04-29T23:14:31.073ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:787 id = dcdf06da-b459-49b5-a63a-2f5501d23d90 version = 0
162026-04-29T23:14:31.073ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:792 id = dcdf06da-b459-49b5-a63a-2f5501d23d90
172026-04-29T23:14:31.073ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90
182026-04-29T23:14:32.963ZINFOoximeter (clickhouse-client): inserting current version collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:813 id = dcdf06da-b459-49b5-a63a-2f5501d23d90 version = 14
192026-04-29T23:14:32.990ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = 3a0c1dca-63ad-4f1e-bbe6-3435d05ed9ed
202026-04-29T23:14:33.041ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-04-29T23:14:33.041ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-04-29T23:14:33.041ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-04-29T23:14:33.041ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-04-29T23:14:33.041ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.0/src/server.rs:335 local_addr = [fd00:1122:3344:101::d]:12223
252026-04-29T23:14:33.067ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-04-29T23:14:33.067ZDEBGoximeter: registered USDT probes
272026-04-29T23:14:33.067ZDEBGoximeter: contacting nexus
282026-04-29T23:14:33.191ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
292026-04-29T23:14:33.416ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "d9560901-4808-4d95-86d8-163ab3556852", "date": "Wed, 29 Apr 2026 23:14:33 GMT"} })
302026-04-29T23:14:33.416ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:464 id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932
312026-04-29T23:14:33.416ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
322026-04-29T23:14:33.417ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
332026-04-29T23:14:33.419ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/bae5936b-a03a-4ec1-9b3b-a6b7c9a15932/producers?sort_by=id_ascending
342026-04-29T23:14:33.838ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/bae5936b-a03a-4ec1-9b3b-a6b7c9a15932/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "d73af715-637e-4865-926a-a5d1d1ec9287", "content-length": "29", "date": "Wed, 29 Apr 2026 23:14:33 GMT"} })
352026-04-29T23:14:33.838ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 0 n_pruned_tasks = 0
362026-04-29T23:14:38.003ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d
372026-04-29T23:14:38.003ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d
382026-04-29T23:14:43.003ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d
392026-04-29T23:14:43.003ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d
402026-04-29T23:14:48.003ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d
412026-04-29T23:14:48.003ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d
422026-04-29T23:14:48.417ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
432026-04-29T23:14:48.417ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/bae5936b-a03a-4ec1-9b3b-a6b7c9a15932/producers?sort_by=id_ascending
442026-04-29T23:14:48.421ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/bae5936b-a03a-4ec1-9b3b-a6b7c9a15932/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "a54632c2-ab00-495d-aa94-b431a0e7b7e7", "content-length": "572", "date": "Wed, 29 Apr 2026 23:14:48 GMT"} })
452026-04-29T23:14:48.424ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/bae5936b-a03a-4ec1-9b3b-a6b7c9a15932/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhMjYyOTU2OS1jMDJiLTRjZDctYTQ1MS0xNTUzYjZhOTE4MGUifX0%3D
462026-04-29T23:14:48.428ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/bae5936b-a03a-4ec1-9b3b-a6b7c9a15932/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhMjYyOTU2OS1jMDJiLTRjZDctYTQ1MS0xNTUzYjZhOTE4MGUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb1ff518-8c6d-4aa4-8991-08414d2cf58f", "content-length": "29", "date": "Wed, 29 Apr 2026 23:14:48 GMT"} })
472026-04-29T23:14:48.428ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:46247 collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 442b970a-e01e-48e4-8172-da9ecdcb8119
482026-04-29T23:14:48.428ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2
492026-04-29T23:14:48.428ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e
502026-04-29T23:14:48.428ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 3 n_pruned_tasks = 0
512026-04-29T23:14:48.430ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 442b970a-e01e-48e4-8172-da9ecdcb8119 producer_ip = fd00:1122:3344:101::2 producer_port = 46247
522026-04-29T23:14:48.430ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 442b970a-e01e-48e4-8172-da9ecdcb8119 producer_ip = fd00:1122:3344:101::2 producer_port = 46247
532026-04-29T23:14:48.430ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
542026-04-29T23:14:48.430ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
552026-04-29T23:14:48.431ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
562026-04-29T23:14:48.432ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 442b970a-e01e-48e4-8172-da9ecdcb8119 producer_ip = fd00:1122:3344:101::2 producer_port = 46247
572026-04-29T23:14:48.432ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
582026-04-29T23:14:48.462ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
592026-04-29T23:14:48.462ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
602026-04-29T23:14:48.462ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
612026-04-29T23:14:48.469ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 142 producer_id = 442b970a-e01e-48e4-8172-da9ecdcb8119 producer_ip = fd00:1122:3344:101::2 producer_port = 46247
622026-04-29T23:14:48.470ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
632026-04-29T23:14:49.429ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
642026-04-29T23:14:49.429ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
652026-04-29T23:14:49.430ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
662026-04-29T23:14:49.463ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
672026-04-29T23:14:49.463ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
682026-04-29T23:14:49.466ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
692026-04-29T23:14:50.429ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
702026-04-29T23:14:50.429ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
712026-04-29T23:14:50.430ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
722026-04-29T23:14:50.463ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
732026-04-29T23:14:50.463ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
742026-04-29T23:14:50.465ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
752026-04-29T23:14:51.429ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
762026-04-29T23:14:51.430ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
772026-04-29T23:14:51.430ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
782026-04-29T23:14:51.463ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
792026-04-29T23:14:51.464ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
802026-04-29T23:14:51.466ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
812026-04-29T23:14:52.429ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
822026-04-29T23:14:52.429ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
832026-04-29T23:14:52.430ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
842026-04-29T23:14:52.463ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
852026-04-29T23:14:52.463ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
862026-04-29T23:14:52.466ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
872026-04-29T23:14:53.003ZDEBGoximeter (database-inserter): inserting samples into database collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_samples = 295
882026-04-29T23:14:53.003ZDEBGoximeter (database-inserter): inserting samples into database collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_samples = 295
892026-04-29T23:14:53.003ZDEBGoximeter (clickhouse-client): unrolling 295 total samples collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90
902026-04-29T23:14:53.024ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90
912026-04-29T23:14:53.040ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.011051357Z } timeseries_name = ddm_router:originated_tunnel_endpoints
922026-04-29T23:14:53.040ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.010984496Z } timeseries_name = ddm_router:originated_underlay_prefixes
932026-04-29T23:14:53.043ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.011306043Z } timeseries_name = ddm_session:advertisements_received
942026-04-29T23:14:53.043ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.011239412Z } timeseries_name = ddm_session:advertisements_sent
952026-04-29T23:14:53.043ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.011811735Z } timeseries_name = ddm_session:imported_tunnel_endpoints
962026-04-29T23:14:53.043ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.011749684Z } timeseries_name = ddm_session:imported_underlay_prefixes
972026-04-29T23:14:53.043ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.011438286Z } timeseries_name = ddm_session:peer_address_changes
982026-04-29T23:14:53.043ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.011372175Z } timeseries_name = ddm_session:peer_expirations
992026-04-29T23:14:53.043ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.011501948Z } timeseries_name = ddm_session:peer_sessions_established
1002026-04-29T23:14:53.043ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.011176130Z } timeseries_name = ddm_session:solicitations_received
1012026-04-29T23:14:53.043ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.011114469Z } timeseries_name = ddm_session:solicitations_sent
1022026-04-29T23:14:53.043ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.011688292Z } timeseries_name = ddm_session:update_send_fail
1032026-04-29T23:14:53.043ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.011624921Z } timeseries_name = ddm_session:updates_received
1042026-04-29T23:14:53.043ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.011563609Z } timeseries_name = ddm_session:updates_sent
1052026-04-29T23:14:53.043ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.010916474Z } timeseries_name = dendrite:sample_collection_duration
1062026-04-29T23:14:53.043ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.006268595Z } timeseries_name = mg_lower:routes_blocked_by_link_state
1072026-04-29T23:14:53.043ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.005915577Z } timeseries_name = oximeter_collector:collections
1082026-04-29T23:14:53.043ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.006138382Z } timeseries_name = static_routing_config:static_nexthops
1092026-04-29T23:14:53.044ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.006071760Z } timeseries_name = static_routing_config:static_routes
1102026-04-29T23:14:53.044ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.006336037Z } timeseries_name = switch_data_link:link_enabled
1112026-04-29T23:14:53.044ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.006408959Z } timeseries_name = switch_data_link:link_up
1122026-04-29T23:14:53.044ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.006205694Z } timeseries_name = switch_rib:active_routes
1132026-04-29T23:14:53.044ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.006601813Z } timeseries_name = switch_table:capacity
1142026-04-29T23:14:53.044ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.006937561Z } timeseries_name = switch_table:collisions
1152026-04-29T23:14:53.044ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.007072374Z } timeseries_name = switch_table:delete_misses
1162026-04-29T23:14:53.044ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.006800798Z } timeseries_name = switch_table:deletes
1172026-04-29T23:14:53.044ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.007138696Z } timeseries_name = switch_table:exhaustion
1182026-04-29T23:14:53.044ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.006734736Z } timeseries_name = switch_table:inserts
1192026-04-29T23:14:53.044ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.006667005Z } timeseries_name = switch_table:occupancy
1202026-04-29T23:14:53.044ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.007005462Z } timeseries_name = switch_table:update_misses
1212026-04-29T23:14:53.044ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-04-29T23:14:53.006870669Z } timeseries_name = switch_table:updates
1222026-04-29T23:14:53.049ZDEBGoximeter (clickhouse-client): inserting 31 new timeseries schema collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90
1232026-04-29T23:14:53.064ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 n_rows = 284 table_name = fields_i16
1242026-04-29T23:14:53.066ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 n_rows = 6 table_name = fields_ipaddr
1252026-04-29T23:14:53.068ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 n_rows = 774 table_name = fields_string
1262026-04-29T23:14:53.070ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 n_rows = 148 table_name = fields_u16
1272026-04-29T23:14:53.072ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 n_rows = 149 table_name = fields_u32
1282026-04-29T23:14:53.074ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 n_rows = 148 table_name = fields_u8
1292026-04-29T23:14:53.076ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 n_rows = 468 table_name = fields_uuid
1302026-04-29T23:14:53.077ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 n_rows = 6 table_name = measurements_bool
1312026-04-29T23:14:53.079ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 n_rows = 218 table_name = measurements_cumulativeu64
1322026-04-29T23:14:53.081ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 n_rows = 1 table_name = measurements_f64
1332026-04-29T23:14:53.082ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 n_rows = 70 table_name = measurements_u64
1342026-04-29T23:14:53.106ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
1352026-04-29T23:14:53.429ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1362026-04-29T23:14:53.429ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1372026-04-29T23:14:53.430ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1382026-04-29T23:14:53.463ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1392026-04-29T23:14:53.463ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1402026-04-29T23:14:53.465ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1412026-04-29T23:14:54.430ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1422026-04-29T23:14:54.430ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1432026-04-29T23:14:54.431ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1442026-04-29T23:14:54.464ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1452026-04-29T23:14:54.464ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1462026-04-29T23:14:54.466ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1472026-04-29T23:14:55.429ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1482026-04-29T23:14:55.429ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1492026-04-29T23:14:55.430ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1502026-04-29T23:14:55.463ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1512026-04-29T23:14:55.463ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1522026-04-29T23:14:55.466ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1532026-04-29T23:14:56.429ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1542026-04-29T23:14:56.429ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1552026-04-29T23:14:56.430ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1562026-04-29T23:14:56.463ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1572026-04-29T23:14:56.463ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1582026-04-29T23:14:56.465ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1592026-04-29T23:14:57.430ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1602026-04-29T23:14:57.430ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1612026-04-29T23:14:57.431ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1622026-04-29T23:14:57.463ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1632026-04-29T23:14:57.463ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1642026-04-29T23:14:57.465ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1652026-04-29T23:14:58.003ZDEBGoximeter (database-inserter): inserting samples into database collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_samples = 150
1662026-04-29T23:14:58.003ZDEBGoximeter (database-inserter): inserting samples into database collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_samples = 150
1672026-04-29T23:14:58.003ZDEBGoximeter (clickhouse-client): unrolling 150 total samples collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90
1682026-04-29T23:14:58.009ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90
1692026-04-29T23:14:58.057ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 n_rows = 30 table_name = fields_string
1702026-04-29T23:14:58.059ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 n_rows = 36 table_name = fields_uuid
1712026-04-29T23:14:58.061ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 n_rows = 110 table_name = measurements_cumulativeu64
1722026-04-29T23:14:58.062ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d id = dcdf06da-b459-49b5-a63a-2f5501d23d90 n_rows = 40 table_name = measurements_u64
1732026-04-29T23:14:58.105ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:315
1742026-04-29T23:14:58.430ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1752026-04-29T23:14:58.430ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 442b970a-e01e-48e4-8172-da9ecdcb8119 producer_ip = fd00:1122:3344:101::2 producer_port = 46247
1762026-04-29T23:14:58.430ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1772026-04-29T23:14:58.430ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 442b970a-e01e-48e4-8172-da9ecdcb8119 producer_ip = fd00:1122:3344:101::2 producer_port = 46247
1782026-04-29T23:14:58.431ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1792026-04-29T23:14:58.442ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 142 producer_id = 442b970a-e01e-48e4-8172-da9ecdcb8119 producer_ip = fd00:1122:3344:101::2 producer_port = 46247
1802026-04-29T23:14:58.463ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1812026-04-29T23:14:58.463ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1822026-04-29T23:14:58.466ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1832026-04-29T23:14:59.429ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1842026-04-29T23:14:59.429ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1852026-04-29T23:14:59.430ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1862026-04-29T23:14:59.463ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1872026-04-29T23:14:59.463ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1882026-04-29T23:14:59.466ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1892026-04-29T23:15:00.429ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1902026-04-29T23:15:00.429ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1912026-04-29T23:15:00.430ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1922026-04-29T23:15:00.463ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1932026-04-29T23:15:00.463ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1942026-04-29T23:15:00.466ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1952026-04-29T23:15:01.429ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1962026-04-29T23:15:01.429ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1972026-04-29T23:15:01.430ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 6b827404-74d1-4153-bda9-5c037d1424f2 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1982026-04-29T23:15:01.463ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1992026-04-29T23:15:01.463ZDEBGoximeter (collection-task): collecting from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2002026-04-29T23:15:01.466ZDEBGoximeter (collection-task): collected results from producer collector_id = bae5936b-a03a-4ec1-9b3b-a6b7c9a15932 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a2629569-c02b-4cd7-a451-1553b6a9180e producer_ip = fd00:1122:3344:101::1 producer_port = 8001