Max level shown:
1 [ Jun 23 22:55:28 Enabled. ]
2 [ Jun 23 22:55:28 Rereading configuration. ]
3 [ Jun 23 22:55:31 Rereading configuration. ]
4 [ Jun 23 22:55:37 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id 26fdb619-6753-40d1-aec4-c7353c5b5541 &"). ]
5 [ Jun 23 22:55:37 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-06-23T22:55:37.529ZDEBGoximeter: registered DTrace probes
82026-06-23T22:55:37.532ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:301
92026-06-23T22:55:37.533ZDEBGoximeter: creating ClickHouse client
102026-06-23T22:55:37.548ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
112026-06-23T22:55:39.184ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:890 id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
122026-06-23T22:55:39.184ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
132026-06-23T22:55:39.184ZINFOoximeter (clickhouse-client): reading db version collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:790 id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
142026-06-23T22:55:39.185ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:890 id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
152026-06-23T22:55:39.185ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:795 id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 version = 0
162026-06-23T22:55:39.185ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:800 id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
172026-06-23T22:55:39.185ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
182026-06-23T22:55:39.881ZINFOoximeter (clickhouse-client): inserting current version collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:821 id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 version = 14
192026-06-23T22:55:39.890ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 8d28184b-8a64-448e-ace6-02dd7b2f446c
202026-06-23T22:55:39.895ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-06-23T22:55:39.896ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-06-23T22:55:39.896ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-06-23T22:55:39.896ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-06-23T22:55:39.896ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.0/src/server.rs:335 local_addr = [fd00:1122:3344:101::d]:12223
252026-06-23T22:55:39.899ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-06-23T22:55:39.899ZDEBGoximeter: registered USDT probes
272026-06-23T22:55:39.899ZDEBGoximeter: contacting nexus
282026-06-23T22:55:39.916ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
292026-06-23T22:55:39.917ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
302026-06-23T22:55:39.917ZWARNoximeter: failed to contact nexus, will retry in 232.644113ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:446
312026-06-23T22:55:40.150ZDEBGoximeter: contacting nexus
322026-06-23T22:55:40.151ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
332026-06-23T22:55:40.151ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
342026-06-23T22:55:40.151ZWARNoximeter: failed to contact nexus, will retry in 728.801667ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:446
352026-06-23T22:55:40.881ZDEBGoximeter: contacting nexus
362026-06-23T22:55:40.881ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
372026-06-23T22:55:40.881ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::c]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
382026-06-23T22:55:40.881ZWARNoximeter: failed to contact nexus, will retry in 946.750213ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:446
392026-06-23T22:55:41.828ZDEBGoximeter: contacting nexus
402026-06-23T22:55:41.828ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
412026-06-23T22:55:41.828ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
422026-06-23T22:55:41.829ZWARNoximeter: failed to contact nexus, will retry in 2.753199144s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:446
432026-06-23T22:55:44.583ZDEBGoximeter: contacting nexus
442026-06-23T22:55:44.583ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
452026-06-23T22:55:44.644ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "8146d0d4-ca8e-4bfd-b448-feffd8bd0691", "date": "Tue, 23 Jun 2026 22:55:44 GMT"} })
462026-06-23T22:55:44.645ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:464 id = 26fdb619-6753-40d1-aec4-c7353c5b5541
472026-06-23T22:55:44.645ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
482026-06-23T22:55:44.646ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
492026-06-23T22:55:44.648ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending
502026-06-23T22:55:44.685ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a81dd09-daa4-4b66-8f08-5c5af1774fa8", "content-length": "29", "date": "Tue, 23 Jun 2026 22:55:44 GMT"} })
512026-06-23T22:55:44.686ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 0 n_pruned_tasks = 0
522026-06-23T22:55:44.891ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
532026-06-23T22:55:44.891ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
542026-06-23T22:55:49.891ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
552026-06-23T22:55:49.891ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
562026-06-23T22:55:54.891ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
572026-06-23T22:55:54.891ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
582026-06-23T22:55:59.645ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
592026-06-23T22:55:59.646ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending
602026-06-23T22:55:59.651ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ea76bd9-2ffa-4ef8-9a89-cae0a38c8b74", "content-length": "29", "date": "Tue, 23 Jun 2026 22:55:59 GMT"} })
612026-06-23T22:55:59.651ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 0 n_pruned_tasks = 0
622026-06-23T22:55:59.891ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
632026-06-23T22:55:59.891ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
642026-06-23T22:56:04.891ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
652026-06-23T22:56:04.891ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
662026-06-23T22:56:09.890ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
672026-06-23T22:56:09.890ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
682026-06-23T22:56:14.646ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
692026-06-23T22:56:14.646ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending
702026-06-23T22:56:14.656ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "26c26b29-ba84-4fa8-8775-96c86002578c", "content-length": "447", "date": "Tue, 23 Jun 2026 22:56:14 GMT"} })
712026-06-23T22:56:14.656ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZTU0ZWM3ZS0zOTMwLTQ4YzgtODc3MS0xMTYzODVkZTQwN2MifX0%3D
722026-06-23T22:56:14.659ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZTU0ZWM3ZS0zOTMwLTQ4YzgtODc3MS0xMTYzODVkZTQwN2MifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "24d7f6be-58da-4000-8e9d-768de9ab1087", "content-length": "29", "date": "Tue, 23 Jun 2026 22:56:14 GMT"} })
732026-06-23T22:56:14.659ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961
742026-06-23T22:56:14.659ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:64621 collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c
752026-06-23T22:56:14.659ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 2 n_pruned_tasks = 0
762026-06-23T22:56:14.660ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
772026-06-23T22:56:14.662ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
782026-06-23T22:56:14.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
792026-06-23T22:56:14.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
802026-06-23T22:56:14.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
812026-06-23T22:56:14.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
822026-06-23T22:56:14.694ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
832026-06-23T22:56:14.695ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
842026-06-23T22:56:14.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 17
852026-06-23T22:56:14.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 17
862026-06-23T22:56:14.892ZDEBGoximeter (clickhouse-client): unrolling 17 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
872026-06-23T22:56:14.898ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
882026-06-23T22:56:14.919ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:56:14.896441850Z } timeseries_name = http_service:request_latency_histogram
892026-06-23T22:56:14.919ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:56:14.896379588Z } timeseries_name = mg_lower:routes_blocked_by_link_state
902026-06-23T22:56:14.919ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:56:14.893812706Z } timeseries_name = oximeter_collector:collections
912026-06-23T22:56:14.919ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:56:14.896248744Z } timeseries_name = static_routing_config:static_nexthops
922026-06-23T22:56:14.919ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:56:14.894000671Z } timeseries_name = static_routing_config:static_routes
932026-06-23T22:56:14.919ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:56:14.896314956Z } timeseries_name = switch_rib:active_routes
942026-06-23T22:56:14.928ZDEBGoximeter (clickhouse-client): inserting 6 new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
952026-06-23T22:56:14.942ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 4 table_name = fields_ipaddr
962026-06-23T22:56:14.946ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 28 table_name = fields_string
972026-06-23T22:56:14.948ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 15 table_name = fields_u16
982026-06-23T22:56:14.949ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 23 table_name = fields_uuid
992026-06-23T22:56:14.953ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 4 table_name = measurements_cumulativeu64
1002026-06-23T22:56:14.955ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
1012026-06-23T22:56:14.957ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 2 table_name = measurements_u64
1022026-06-23T22:56:14.994ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
1032026-06-23T22:56:15.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1042026-06-23T22:56:15.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1052026-06-23T22:56:15.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1062026-06-23T22:56:16.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1072026-06-23T22:56:16.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1082026-06-23T22:56:16.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1092026-06-23T22:56:17.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1102026-06-23T22:56:17.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1112026-06-23T22:56:17.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1122026-06-23T22:56:18.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1132026-06-23T22:56:18.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1142026-06-23T22:56:18.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1152026-06-23T22:56:19.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1162026-06-23T22:56:19.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1172026-06-23T22:56:19.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1182026-06-23T22:56:19.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 20
1192026-06-23T22:56:19.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 20
1202026-06-23T22:56:19.890ZDEBGoximeter (clickhouse-client): unrolling 20 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
1212026-06-23T22:56:19.891ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
1222026-06-23T22:56:19.928ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 4 table_name = fields_string
1232026-06-23T22:56:19.930ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 8 table_name = fields_uuid
1242026-06-23T22:56:19.933ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 10 table_name = measurements_cumulativeu64
1252026-06-23T22:56:19.934ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 10 table_name = measurements_u64
1262026-06-23T22:56:19.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
1272026-06-23T22:56:20.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1282026-06-23T22:56:20.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1292026-06-23T22:56:20.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1302026-06-23T22:56:21.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1312026-06-23T22:56:21.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1322026-06-23T22:56:21.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1332026-06-23T22:56:22.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1342026-06-23T22:56:22.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1352026-06-23T22:56:22.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1362026-06-23T22:56:23.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1372026-06-23T22:56:23.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1382026-06-23T22:56:23.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1392026-06-23T22:56:24.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1402026-06-23T22:56:24.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1412026-06-23T22:56:24.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
1422026-06-23T22:56:24.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
1432026-06-23T22:56:24.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1442026-06-23T22:56:24.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
1452026-06-23T22:56:24.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 31
1462026-06-23T22:56:24.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 31
1472026-06-23T22:56:24.890ZDEBGoximeter (clickhouse-client): unrolling 31 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
1482026-06-23T22:56:24.892ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
1492026-06-23T22:56:24.896ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 26 table_name = fields_string
1502026-06-23T22:56:24.897ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = fields_u16
1512026-06-23T22:56:24.899ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 19 table_name = fields_uuid
1522026-06-23T22:56:24.900ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 10 table_name = measurements_cumulativeu64
1532026-06-23T22:56:24.901ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
1542026-06-23T22:56:24.902ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 10 table_name = measurements_u64
1552026-06-23T22:56:24.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
1562026-06-23T22:56:25.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1572026-06-23T22:56:25.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1582026-06-23T22:56:25.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1592026-06-23T22:56:26.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1602026-06-23T22:56:26.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1612026-06-23T22:56:26.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1622026-06-23T22:56:27.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1632026-06-23T22:56:27.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1642026-06-23T22:56:27.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1652026-06-23T22:56:28.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1662026-06-23T22:56:28.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1672026-06-23T22:56:28.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1682026-06-23T22:56:29.646ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
1692026-06-23T22:56:29.646ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending
1702026-06-23T22:56:29.650ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "aed3942e-7354-4918-99aa-1a093469e5e7", "content-length": "585", "date": "Tue, 23 Jun 2026 22:56:29 GMT"} })
1712026-06-23T22:56:29.650ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZTU0ZWM3ZS0zOTMwLTQ4YzgtODc3MS0xMTYzODVkZTQwN2MifX0%3D
1722026-06-23T22:56:29.654ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZTU0ZWM3ZS0zOTMwLTQ4YzgtODc3MS0xMTYzODVkZTQwN2MifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "646abe5d-2074-41a1-a2e3-d04b34a81b7a", "content-length": "29", "date": "Tue, 23 Jun 2026 22:56:29 GMT"} })
1732026-06-23T22:56:29.654ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:33407 collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086
1742026-06-23T22:56:29.654ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 3 n_pruned_tasks = 0
1752026-06-23T22:56:29.655ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
1762026-06-23T22:56:29.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
1772026-06-23T22:56:29.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
1782026-06-23T22:56:29.660ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 9 producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
1792026-06-23T22:56:29.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1802026-06-23T22:56:29.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1812026-06-23T22:56:29.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1822026-06-23T22:56:29.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 30
1832026-06-23T22:56:29.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 30
1842026-06-23T22:56:29.891ZDEBGoximeter (clickhouse-client): unrolling 30 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
1852026-06-23T22:56:29.892ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
1862026-06-23T22:56:29.895ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:56:29.892631266Z } timeseries_name = collection_target:cpus_provisioned
1872026-06-23T22:56:29.895ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:56:29.892692578Z } timeseries_name = collection_target:ram_provisioned
1882026-06-23T22:56:29.895ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:56:29.892754460Z } timeseries_name = collection_target:virtual_disk_space_provisioned
1892026-06-23T22:56:29.895ZDEBGoximeter (clickhouse-client): inserting 3 new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
1902026-06-23T22:56:29.898ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 2 table_name = fields_ipaddr
1912026-06-23T22:56:29.900ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = fields_string
1922026-06-23T22:56:29.901ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 5 table_name = fields_u16
1932026-06-23T22:56:29.902ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 19 table_name = fields_uuid
1942026-06-23T22:56:29.903ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_cumulativeu64
1952026-06-23T22:56:29.905ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 3 table_name = measurements_histogramu64
1962026-06-23T22:56:29.906ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 6 table_name = measurements_i64
1972026-06-23T22:56:29.907ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 10 table_name = measurements_u64
1982026-06-23T22:56:29.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
1992026-06-23T22:56:30.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2002026-06-23T22:56:30.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2012026-06-23T22:56:30.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2022026-06-23T22:56:31.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2032026-06-23T22:56:31.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2042026-06-23T22:56:31.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2052026-06-23T22:56:32.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2062026-06-23T22:56:32.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2072026-06-23T22:56:32.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2082026-06-23T22:56:33.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2092026-06-23T22:56:33.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2102026-06-23T22:56:33.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2112026-06-23T22:56:34.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2122026-06-23T22:56:34.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2132026-06-23T22:56:34.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
2142026-06-23T22:56:34.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
2152026-06-23T22:56:34.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2162026-06-23T22:56:34.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
2172026-06-23T22:56:34.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 31
2182026-06-23T22:56:34.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 31
2192026-06-23T22:56:34.890ZDEBGoximeter (clickhouse-client): unrolling 31 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
2202026-06-23T22:56:34.892ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
2212026-06-23T22:56:34.896ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 26 table_name = fields_string
2222026-06-23T22:56:34.898ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = fields_u16
2232026-06-23T22:56:34.899ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 19 table_name = fields_uuid
2242026-06-23T22:56:34.900ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 10 table_name = measurements_cumulativeu64
2252026-06-23T22:56:34.902ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
2262026-06-23T22:56:34.903ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 10 table_name = measurements_u64
2272026-06-23T22:56:34.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
2282026-06-23T22:56:35.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2292026-06-23T22:56:35.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2302026-06-23T22:56:35.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2312026-06-23T22:56:36.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2322026-06-23T22:56:36.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2332026-06-23T22:56:36.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2342026-06-23T22:56:37.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2352026-06-23T22:56:37.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2362026-06-23T22:56:37.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2372026-06-23T22:56:38.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2382026-06-23T22:56:38.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2392026-06-23T22:56:38.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2402026-06-23T22:56:39.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
2412026-06-23T22:56:39.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
2422026-06-23T22:56:39.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 20 producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
2432026-06-23T22:56:39.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2442026-06-23T22:56:39.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2452026-06-23T22:56:39.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2462026-06-23T22:56:39.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 40
2472026-06-23T22:56:39.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 40
2482026-06-23T22:56:39.891ZDEBGoximeter (clickhouse-client): unrolling 40 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
2492026-06-23T22:56:39.893ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
2502026-06-23T22:56:39.903ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 26 table_name = fields_string
2512026-06-23T22:56:39.904ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = fields_u16
2522026-06-23T22:56:39.905ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 24 table_name = fields_uuid
2532026-06-23T22:56:39.906ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 10 table_name = measurements_cumulativeu64
2542026-06-23T22:56:39.908ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
2552026-06-23T22:56:39.909ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 9 table_name = measurements_i64
2562026-06-23T22:56:39.911ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 10 table_name = measurements_u64
2572026-06-23T22:56:39.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
2582026-06-23T22:56:40.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2592026-06-23T22:56:40.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2602026-06-23T22:56:40.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2612026-06-23T22:56:41.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2622026-06-23T22:56:41.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2632026-06-23T22:56:41.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2642026-06-23T22:56:42.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2652026-06-23T22:56:42.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2662026-06-23T22:56:42.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2672026-06-23T22:56:43.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2682026-06-23T22:56:43.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2692026-06-23T22:56:43.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2702026-06-23T22:56:44.646ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
2712026-06-23T22:56:44.646ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending
2722026-06-23T22:56:44.649ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "141ed910-1397-4649-bbf5-e93c1807468d", "content-length": "723", "date": "Tue, 23 Jun 2026 22:56:44 GMT"} })
2732026-06-23T22:56:44.649ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZTU0ZWM3ZS0zOTMwLTQ4YzgtODc3MS0xMTYzODVkZTQwN2MifX0%3D
2742026-06-23T22:56:44.653ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhZTU0ZWM3ZS0zOTMwLTQ4YzgtODc3MS0xMTYzODVkZTQwN2MifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "e182d142-bff8-4ea1-913d-6bd99ca81b77", "content-length": "29", "date": "Tue, 23 Jun 2026 22:56:44 GMT"} })
2752026-06-23T22:56:44.653ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:39040 collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df
2762026-06-23T22:56:44.653ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 4 n_pruned_tasks = 0
2772026-06-23T22:56:44.654ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
2782026-06-23T22:56:44.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
2792026-06-23T22:56:44.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
2802026-06-23T22:56:44.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2812026-06-23T22:56:44.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2822026-06-23T22:56:44.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
2832026-06-23T22:56:44.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
2842026-06-23T22:56:44.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2852026-06-23T22:56:44.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
2862026-06-23T22:56:44.696ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 492 producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
2872026-06-23T22:56:44.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 524
2882026-06-23T22:56:44.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 524
2892026-06-23T22:56:44.891ZDEBGoximeter (clickhouse-client): unrolling 524 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
2902026-06-23T22:56:44.907ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
2912026-06-23T22:56:44.909ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:56:44.893112904Z } timeseries_name = switch_port_control_data_link:bytes_received
2922026-06-23T22:56:44.909ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:56:44.893236718Z } timeseries_name = switch_port_control_data_link:bytes_sent
2932026-06-23T22:56:44.909ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:56:44.892987141Z } timeseries_name = switch_port_control_data_link:errors_received
2942026-06-23T22:56:44.909ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:56:44.893050423Z } timeseries_name = switch_port_control_data_link:errors_sent
2952026-06-23T22:56:44.909ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:56:44.893174236Z } timeseries_name = switch_port_control_data_link:packets_received
2962026-06-23T22:56:44.909ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:56:44.893309590Z } timeseries_name = switch_port_control_data_link:packets_sent
2972026-06-23T22:56:44.913ZDEBGoximeter (clickhouse-client): inserting 6 new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
2982026-06-23T22:56:44.917ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 24 table_name = fields_i16
2992026-06-23T22:56:44.918ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 2 table_name = fields_ipaddr
3002026-06-23T22:56:44.919ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 147 table_name = fields_string
3012026-06-23T22:56:44.920ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 25 table_name = fields_u16
3022026-06-23T22:56:44.922ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 24 table_name = fields_u32
3032026-06-23T22:56:44.923ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 12 table_name = fields_u8
3042026-06-23T22:56:44.924ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 57 table_name = fields_uuid
3052026-06-23T22:56:44.925ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 503 table_name = measurements_cumulativeu64
3062026-06-23T22:56:44.927ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
3072026-06-23T22:56:44.929ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 10 table_name = measurements_u64
3082026-06-23T22:56:44.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
3092026-06-23T22:56:45.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3102026-06-23T22:56:45.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3112026-06-23T22:56:45.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3122026-06-23T22:56:46.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3132026-06-23T22:56:46.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3142026-06-23T22:56:46.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3152026-06-23T22:56:47.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3162026-06-23T22:56:47.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3172026-06-23T22:56:47.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3182026-06-23T22:56:48.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3192026-06-23T22:56:48.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3202026-06-23T22:56:48.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3212026-06-23T22:56:49.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
3222026-06-23T22:56:49.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
3232026-06-23T22:56:49.658ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 29 producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
3242026-06-23T22:56:49.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3252026-06-23T22:56:49.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3262026-06-23T22:56:49.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3272026-06-23T22:56:49.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 49
3282026-06-23T22:56:49.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 49
3292026-06-23T22:56:49.890ZDEBGoximeter (clickhouse-client): unrolling 49 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
3302026-06-23T22:56:49.892ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
3312026-06-23T22:56:49.898ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 50 table_name = fields_string
3322026-06-23T22:56:49.899ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 23 table_name = fields_u16
3332026-06-23T22:56:49.901ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 36 table_name = fields_uuid
3342026-06-23T22:56:49.902ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 10 table_name = measurements_cumulativeu64
3352026-06-23T22:56:49.904ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 23 table_name = measurements_histogramu64
3362026-06-23T22:56:49.906ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 6 table_name = measurements_i64
3372026-06-23T22:56:49.907ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 10 table_name = measurements_u64
3382026-06-23T22:56:49.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
3392026-06-23T22:56:50.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3402026-06-23T22:56:50.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3412026-06-23T22:56:50.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3422026-06-23T22:56:51.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3432026-06-23T22:56:51.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3442026-06-23T22:56:51.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3452026-06-23T22:56:52.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3462026-06-23T22:56:52.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3472026-06-23T22:56:52.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3482026-06-23T22:56:53.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3492026-06-23T22:56:53.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3502026-06-23T22:56:53.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3512026-06-23T22:56:54.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3522026-06-23T22:56:54.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3532026-06-23T22:56:54.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
3542026-06-23T22:56:54.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
3552026-06-23T22:56:54.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3562026-06-23T22:56:54.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
3572026-06-23T22:56:54.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 31
3582026-06-23T22:56:54.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 31
3592026-06-23T22:56:54.890ZDEBGoximeter (clickhouse-client): unrolling 31 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
3602026-06-23T22:56:54.892ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
3612026-06-23T22:56:54.896ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 26 table_name = fields_string
3622026-06-23T22:56:54.897ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = fields_u16
3632026-06-23T22:56:54.898ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 19 table_name = fields_uuid
3642026-06-23T22:56:54.900ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 10 table_name = measurements_cumulativeu64
3652026-06-23T22:56:54.902ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
3662026-06-23T22:56:54.903ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 10 table_name = measurements_u64
3672026-06-23T22:56:54.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
3682026-06-23T22:56:55.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3692026-06-23T22:56:55.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3702026-06-23T22:56:55.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3712026-06-23T22:56:56.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3722026-06-23T22:56:56.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3732026-06-23T22:56:56.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3742026-06-23T22:56:57.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3752026-06-23T22:56:57.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3762026-06-23T22:56:57.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3772026-06-23T22:56:58.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3782026-06-23T22:56:58.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3792026-06-23T22:56:58.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3802026-06-23T22:56:59.646ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
3812026-06-23T22:56:59.646ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending
3822026-06-23T22:56:59.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
3832026-06-23T22:56:59.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
3842026-06-23T22:56:59.658ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
3852026-06-23T22:56:59.661ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "90d58f44-97ea-4c0d-a1d9-a35322f2bd37", "content-length": "1140", "date": "Tue, 23 Jun 2026 22:56:59 GMT"} })
3862026-06-23T22:56:59.661ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D
3872026-06-23T22:56:59.664ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff6048a4-fe4e-42aa-b2be-ce59958ed848", "content-length": "29", "date": "Tue, 23 Jun 2026 22:56:59 GMT"} })
3882026-06-23T22:56:59.664ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:46180 collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 462f5276-d6e3-49e7-9d58-26b144804069
3892026-06-23T22:56:59.664ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:50068 collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2
3902026-06-23T22:56:59.664ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:52684 collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370
3912026-06-23T22:56:59.664ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 7 n_pruned_tasks = 0
3922026-06-23T22:56:59.665ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
3932026-06-23T22:56:59.665ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
3942026-06-23T22:56:59.665ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
3952026-06-23T22:56:59.665ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
3962026-06-23T22:56:59.665ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
3972026-06-23T22:56:59.665ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
3982026-06-23T22:56:59.665ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
3992026-06-23T22:56:59.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
4002026-06-23T22:56:59.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
4012026-06-23T22:56:59.674ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 12 producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
4022026-06-23T22:56:59.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4032026-06-23T22:56:59.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4042026-06-23T22:56:59.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4052026-06-23T22:56:59.683ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
4062026-06-23T22:56:59.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 61
4072026-06-23T22:56:59.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 61
4082026-06-23T22:56:59.891ZDEBGoximeter (clickhouse-client): unrolling 61 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
4092026-06-23T22:56:59.893ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
4102026-06-23T22:56:59.897ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("database_transaction:retry_data"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "attempt", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:56:59.893671306Z } timeseries_name = database_transaction:retry_data
4112026-06-23T22:56:59.897ZDEBGoximeter (clickhouse-client): inserting 1 new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
4122026-06-23T22:56:59.901ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 6 table_name = fields_ipaddr
4132026-06-23T22:56:59.902ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 70 table_name = fields_string
4142026-06-23T22:56:59.903ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 37 table_name = fields_u16
4152026-06-23T22:56:59.904ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1 table_name = fields_u32
4162026-06-23T22:56:59.906ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 51 table_name = fields_uuid
4172026-06-23T22:56:59.907ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 13 table_name = measurements_cumulativeu64
4182026-06-23T22:56:59.908ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1 table_name = measurements_f64
4192026-06-23T22:56:59.910ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = measurements_histogramu64
4202026-06-23T22:56:59.911ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 6 table_name = measurements_i64
4212026-06-23T22:56:59.912ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 10 table_name = measurements_u64
4222026-06-23T22:56:59.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
4232026-06-23T22:57:00.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 10958 producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
4242026-06-23T22:57:00.297ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 10958
4252026-06-23T22:57:00.297ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 10958
4262026-06-23T22:57:00.297ZDEBGoximeter (clickhouse-client): unrolling 10958 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
4272026-06-23T22:57:00.398ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
4282026-06-23T22:57:00.597ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
4292026-06-23T22:57:00.600ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("kstat_sampler:expired_targets"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:00.575731884Z } timeseries_name = kstat_sampler:expired_targets
4302026-06-23T22:57:00.600ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_cpu:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "cpu_id", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:00.323107343Z } timeseries_name = sled_cpu:cpu_nsec
4312026-06-23T22:57:00.600ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:00.298164454Z } timeseries_name = sled_data_link:bytes_received
4322026-06-23T22:57:00.600ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:00.298281447Z } timeseries_name = sled_data_link:bytes_sent
4332026-06-23T22:57:00.600ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:00.298041290Z } timeseries_name = sled_data_link:errors_received
4342026-06-23T22:57:00.600ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:00.298104282Z } timeseries_name = sled_data_link:errors_sent
4352026-06-23T22:57:00.600ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:00.298223035Z } timeseries_name = sled_data_link:packets_received
4362026-06-23T22:57:00.600ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:00.298338508Z } timeseries_name = sled_data_link:packets_sent
4372026-06-23T22:57:00.600ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_dataset:bytes_used"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "dataset_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "dataset_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "dataset_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:00.577037791Z } timeseries_name = zfs_dataset:bytes_used
4382026-06-23T22:57:00.600ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_pool:bytes_allocated"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:00.576246278Z } timeseries_name = zfs_pool:bytes_allocated
4392026-06-23T22:57:00.600ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_pool:bytes_total"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:00.576304290Z } timeseries_name = zfs_pool:bytes_total
4402026-06-23T22:57:00.600ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zone:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_type", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:00.496640167Z } timeseries_name = zone:cpu_nsec
4412026-06-23T22:57:00.643ZDEBGoximeter (clickhouse-client): inserting 12 new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
4422026-06-23T22:57:00.649ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 3204 table_name = fields_string
4432026-06-23T22:57:00.650ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 9 table_name = fields_u16
4442026-06-23T22:57:00.652ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 953 table_name = fields_u32
4452026-06-23T22:57:00.654ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1806 table_name = fields_uuid
4462026-06-23T22:57:00.660ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 10189 table_name = measurements_cumulativeu64
4472026-06-23T22:57:00.662ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 9 table_name = measurements_histogramu64
4482026-06-23T22:57:00.663ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 760 table_name = measurements_u64
4492026-06-23T22:57:00.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4502026-06-23T22:57:00.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4512026-06-23T22:57:00.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4522026-06-23T22:57:01.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4532026-06-23T22:57:01.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4542026-06-23T22:57:01.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4552026-06-23T22:57:02.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4562026-06-23T22:57:02.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4572026-06-23T22:57:02.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4582026-06-23T22:57:03.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4592026-06-23T22:57:03.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4602026-06-23T22:57:03.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4612026-06-23T22:57:04.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4622026-06-23T22:57:04.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4632026-06-23T22:57:04.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
4642026-06-23T22:57:04.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
4652026-06-23T22:57:04.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4662026-06-23T22:57:04.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
4672026-06-23T22:57:04.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 31
4682026-06-23T22:57:04.891ZDEBGoximeter (clickhouse-client): unrolling 31 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
4692026-06-23T22:57:04.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 31
4702026-06-23T22:57:04.893ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
4712026-06-23T22:57:04.897ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 26 table_name = fields_string
4722026-06-23T22:57:04.899ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = fields_u16
4732026-06-23T22:57:04.900ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 19 table_name = fields_uuid
4742026-06-23T22:57:04.901ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 10 table_name = measurements_cumulativeu64
4752026-06-23T22:57:04.903ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
4762026-06-23T22:57:04.905ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 10 table_name = measurements_u64
4772026-06-23T22:57:04.993ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
4782026-06-23T22:57:05.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4792026-06-23T22:57:05.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4802026-06-23T22:57:05.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4812026-06-23T22:57:06.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4822026-06-23T22:57:06.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4832026-06-23T22:57:06.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4842026-06-23T22:57:07.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4852026-06-23T22:57:07.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4862026-06-23T22:57:07.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4872026-06-23T22:57:08.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4882026-06-23T22:57:08.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4892026-06-23T22:57:08.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
4902026-06-23T22:57:09.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
4912026-06-23T22:57:09.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
4922026-06-23T22:57:09.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
4932026-06-23T22:57:09.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
4942026-06-23T22:57:09.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
4952026-06-23T22:57:09.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
4962026-06-23T22:57:09.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
4972026-06-23T22:57:09.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
4982026-06-23T22:57:09.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
4992026-06-23T22:57:09.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5002026-06-23T22:57:09.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5012026-06-23T22:57:09.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5022026-06-23T22:57:09.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 51
5032026-06-23T22:57:09.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 51
5042026-06-23T22:57:09.890ZDEBGoximeter (clickhouse-client): unrolling 51 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
5052026-06-23T22:57:09.892ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
5062026-06-23T22:57:09.897ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 66 table_name = fields_string
5072026-06-23T22:57:09.898ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = fields_u16
5082026-06-23T22:57:09.900ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 39 table_name = fields_uuid
5092026-06-23T22:57:09.901ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 10 table_name = measurements_cumulativeu64
5102026-06-23T22:57:09.902ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = measurements_histogramu64
5112026-06-23T22:57:09.904ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 10 table_name = measurements_u64
5122026-06-23T22:57:09.991ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
5132026-06-23T22:57:10.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5142026-06-23T22:57:10.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5152026-06-23T22:57:10.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5162026-06-23T22:57:11.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5172026-06-23T22:57:11.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5182026-06-23T22:57:11.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5192026-06-23T22:57:12.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5202026-06-23T22:57:12.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5212026-06-23T22:57:12.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5222026-06-23T22:57:13.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5232026-06-23T22:57:13.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5242026-06-23T22:57:13.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5252026-06-23T22:57:14.645ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
5262026-06-23T22:57:14.646ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending
5272026-06-23T22:57:14.649ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "779d3771-812d-4373-b9ef-59620f7ebf07", "content-length": "1140", "date": "Tue, 23 Jun 2026 22:57:14 GMT"} })
5282026-06-23T22:57:14.649ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D
5292026-06-23T22:57:14.653ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "76ab0a5d-394c-4e8d-9cda-afc018a7fc10", "content-length": "29", "date": "Tue, 23 Jun 2026 22:57:14 GMT"} })
5302026-06-23T22:57:14.653ZDEBGoximeter (oximeter-agent): received request to register existing metric producer, updating collection information address = [fd00:1122:3344:101::2]:35012 collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df
5312026-06-23T22:57:14.653ZDEBGoximeter (collection-task-handle): notified collection task of new producer endpoint collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
5322026-06-23T22:57:14.653ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 7 n_pruned_tasks = 0
5332026-06-23T22:57:14.653ZDEBGoximeter (collection-task): collection task received request to update its producer information address = [fd00:1122:3344:101::2]:35012 collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
5342026-06-23T22:57:14.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
5352026-06-23T22:57:14.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
5362026-06-23T22:57:14.659ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
5372026-06-23T22:57:14.659ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5382026-06-23T22:57:14.675ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
5392026-06-23T22:57:14.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5402026-06-23T22:57:14.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
5412026-06-23T22:57:14.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5422026-06-23T22:57:14.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
5432026-06-23T22:57:14.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5442026-06-23T22:57:14.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
5452026-06-23T22:57:14.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 173
5462026-06-23T22:57:14.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 173
5472026-06-23T22:57:14.890ZDEBGoximeter (clickhouse-client): unrolling 173 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
5482026-06-23T22:57:14.896ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
5492026-06-23T22:57:14.899ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:14.895715208Z } timeseries_name = dendrite:sample_collection_duration
5502026-06-23T22:57:14.899ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:14.891567011Z } timeseries_name = switch_data_link:link_enabled
5512026-06-23T22:57:14.899ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:14.891628953Z } timeseries_name = switch_data_link:link_up
5522026-06-23T22:57:14.899ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:14.891747736Z } timeseries_name = switch_table:capacity
5532026-06-23T22:57:14.899ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:14.892042354Z } timeseries_name = switch_table:collisions
5542026-06-23T22:57:14.899ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:14.892163418Z } timeseries_name = switch_table:delete_misses
5552026-06-23T22:57:14.899ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:14.891921941Z } timeseries_name = switch_table:deletes
5562026-06-23T22:57:14.899ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:14.892221810Z } timeseries_name = switch_table:exhaustion
5572026-06-23T22:57:14.899ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:14.891864140Z } timeseries_name = switch_table:inserts
5582026-06-23T22:57:14.899ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:14.891806088Z } timeseries_name = switch_table:occupancy
5592026-06-23T22:57:14.899ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:14.892103256Z } timeseries_name = switch_table:update_misses
5602026-06-23T22:57:14.899ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:14.891981633Z } timeseries_name = switch_table:updates
5612026-06-23T22:57:14.901ZDEBGoximeter (clickhouse-client): inserting 12 new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
5622026-06-23T22:57:14.905ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 280 table_name = fields_i16
5632026-06-23T22:57:14.906ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 4 table_name = fields_ipaddr
5642026-06-23T22:57:14.908ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 749 table_name = fields_string
5652026-06-23T22:57:14.909ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 155 table_name = fields_u16
5662026-06-23T22:57:14.910ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 145 table_name = fields_u32
5672026-06-23T22:57:14.911ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 144 table_name = fields_u8
5682026-06-23T22:57:14.913ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 443 table_name = fields_uuid
5692026-06-23T22:57:14.914ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 4 table_name = measurements_bool
5702026-06-23T22:57:14.915ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 117 table_name = measurements_cumulativeu64
5712026-06-23T22:57:14.916ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1 table_name = measurements_f64
5722026-06-23T22:57:14.918ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
5732026-06-23T22:57:14.919ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 40 table_name = measurements_u64
5742026-06-23T22:57:14.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
5752026-06-23T22:57:15.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5762026-06-23T22:57:15.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5772026-06-23T22:57:15.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5782026-06-23T22:57:16.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5792026-06-23T22:57:16.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5802026-06-23T22:57:16.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5812026-06-23T22:57:17.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5822026-06-23T22:57:17.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5832026-06-23T22:57:17.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5842026-06-23T22:57:18.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5852026-06-23T22:57:18.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5862026-06-23T22:57:18.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5872026-06-23T22:57:19.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
5882026-06-23T22:57:19.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
5892026-06-23T22:57:19.658ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
5902026-06-23T22:57:19.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
5912026-06-23T22:57:19.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
5922026-06-23T22:57:19.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
5932026-06-23T22:57:19.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
5942026-06-23T22:57:19.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
5952026-06-23T22:57:19.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
5962026-06-23T22:57:19.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5972026-06-23T22:57:19.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5982026-06-23T22:57:19.682ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5992026-06-23T22:57:19.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 51
6002026-06-23T22:57:19.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 51
6012026-06-23T22:57:19.891ZDEBGoximeter (clickhouse-client): unrolling 51 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
6022026-06-23T22:57:19.893ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
6032026-06-23T22:57:19.898ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 66 table_name = fields_string
6042026-06-23T22:57:19.899ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = fields_u16
6052026-06-23T22:57:19.901ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 39 table_name = fields_uuid
6062026-06-23T22:57:19.902ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 10 table_name = measurements_cumulativeu64
6072026-06-23T22:57:19.904ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = measurements_histogramu64
6082026-06-23T22:57:19.905ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 10 table_name = measurements_u64
6092026-06-23T22:57:19.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
6102026-06-23T22:57:20.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6112026-06-23T22:57:20.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6122026-06-23T22:57:20.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6132026-06-23T22:57:21.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6142026-06-23T22:57:21.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6152026-06-23T22:57:21.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6162026-06-23T22:57:22.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6172026-06-23T22:57:22.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6182026-06-23T22:57:22.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6192026-06-23T22:57:23.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6202026-06-23T22:57:23.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6212026-06-23T22:57:23.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6222026-06-23T22:57:24.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
6232026-06-23T22:57:24.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
6242026-06-23T22:57:24.665ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
6252026-06-23T22:57:24.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6262026-06-23T22:57:24.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6272026-06-23T22:57:24.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
6282026-06-23T22:57:24.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
6292026-06-23T22:57:24.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6302026-06-23T22:57:24.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
6312026-06-23T22:57:24.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 171
6322026-06-23T22:57:24.891ZDEBGoximeter (clickhouse-client): unrolling 171 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
6332026-06-23T22:57:24.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 171
6342026-06-23T22:57:24.896ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
6352026-06-23T22:57:24.904ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 280 table_name = fields_i16
6362026-06-23T22:57:24.906ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 747 table_name = fields_string
6372026-06-23T22:57:24.907ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 151 table_name = fields_u16
6382026-06-23T22:57:24.909ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 145 table_name = fields_u32
6392026-06-23T22:57:24.910ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 144 table_name = fields_u8
6402026-06-23T22:57:24.912ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 439 table_name = fields_uuid
6412026-06-23T22:57:24.913ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 4 table_name = measurements_bool
6422026-06-23T22:57:24.914ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 115 table_name = measurements_cumulativeu64
6432026-06-23T22:57:24.916ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1 table_name = measurements_f64
6442026-06-23T22:57:24.917ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
6452026-06-23T22:57:24.919ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 40 table_name = measurements_u64
6462026-06-23T22:57:24.991ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
6472026-06-23T22:57:25.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6482026-06-23T22:57:25.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6492026-06-23T22:57:25.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6502026-06-23T22:57:26.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6512026-06-23T22:57:26.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6522026-06-23T22:57:26.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6532026-06-23T22:57:27.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6542026-06-23T22:57:27.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6552026-06-23T22:57:27.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6562026-06-23T22:57:28.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6572026-06-23T22:57:28.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6582026-06-23T22:57:28.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6592026-06-23T22:57:29.646ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
6602026-06-23T22:57:29.646ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending
6612026-06-23T22:57:29.649ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3cbce01-2483-46fd-8a76-b8794bb6ac52", "content-length": "1276", "date": "Tue, 23 Jun 2026 22:57:29 GMT"} })
6622026-06-23T22:57:29.649ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D
6632026-06-23T22:57:29.652ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "3775b280-986f-4027-9821-900586de91a5", "content-length": "29", "date": "Tue, 23 Jun 2026 22:57:29 GMT"} })
6642026-06-23T22:57:29.653ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e
6652026-06-23T22:57:29.655ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 8 n_pruned_tasks = 0
6662026-06-23T22:57:29.655ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6672026-06-23T22:57:29.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6682026-06-23T22:57:29.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6692026-06-23T22:57:29.655ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
6702026-06-23T22:57:29.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
6712026-06-23T22:57:29.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
6722026-06-23T22:57:29.659ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
6732026-06-23T22:57:29.660ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6742026-06-23T22:57:29.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
6752026-06-23T22:57:29.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
6762026-06-23T22:57:29.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
6772026-06-23T22:57:29.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
6782026-06-23T22:57:29.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
6792026-06-23T22:57:29.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
6802026-06-23T22:57:29.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
6812026-06-23T22:57:29.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
6822026-06-23T22:57:29.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6832026-06-23T22:57:29.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6842026-06-23T22:57:29.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6852026-06-23T22:57:29.736ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 1692 producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
6862026-06-23T22:57:29.739ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 1771
6872026-06-23T22:57:29.739ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 1771
6882026-06-23T22:57:29.739ZDEBGoximeter (clickhouse-client): unrolling 1771 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
6892026-06-23T22:57:29.789ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
6902026-06-23T22:57:29.793ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:29.740918983Z } timeseries_name = ddm_router:originated_tunnel_endpoints
6912026-06-23T22:57:29.793ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:29.740852881Z } timeseries_name = ddm_router:originated_underlay_prefixes
6922026-06-23T22:57:29.793ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:29.741144349Z } timeseries_name = ddm_session:advertisements_received
6932026-06-23T22:57:29.793ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:29.741089157Z } timeseries_name = ddm_session:advertisements_sent
6942026-06-23T22:57:29.793ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:29.741596142Z } timeseries_name = ddm_session:imported_tunnel_endpoints
6952026-06-23T22:57:29.793ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:29.741539840Z } timeseries_name = ddm_session:imported_underlay_prefixes
6962026-06-23T22:57:29.793ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:29.741257792Z } timeseries_name = ddm_session:peer_address_changes
6972026-06-23T22:57:29.793ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:29.741201611Z } timeseries_name = ddm_session:peer_expirations
6982026-06-23T22:57:29.793ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:29.741314024Z } timeseries_name = ddm_session:peer_sessions_established
6992026-06-23T22:57:29.793ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:29.741033286Z } timeseries_name = ddm_session:solicitations_received
7002026-06-23T22:57:29.793ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:29.740976284Z } timeseries_name = ddm_session:solicitations_sent
7012026-06-23T22:57:29.793ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:29.741482788Z } timeseries_name = ddm_session:update_send_fail
7022026-06-23T22:57:29.793ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:29.741426857Z } timeseries_name = ddm_session:updates_received
7032026-06-23T22:57:29.793ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-23T22:57:29.741370925Z } timeseries_name = ddm_session:updates_sent
7042026-06-23T22:57:29.804ZDEBGoximeter (clickhouse-client): inserting 14 new timeseries schema collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
7052026-06-23T22:57:29.808ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 4 table_name = fields_ipaddr
7062026-06-23T22:57:29.810ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 2461 table_name = fields_string
7072026-06-23T22:57:29.811ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 44 table_name = fields_u16
7082026-06-23T22:57:29.813ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 801 table_name = fields_u32
7092026-06-23T22:57:29.815ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1319 table_name = fields_uuid
7102026-06-23T22:57:29.817ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1715 table_name = measurements_cumulativeu64
7112026-06-23T22:57:29.819ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 40 table_name = measurements_histogramu64
7122026-06-23T22:57:29.820ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 16 table_name = measurements_u64
7132026-06-23T22:57:29.839ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
7142026-06-23T22:57:29.891ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
7152026-06-23T22:57:29.891ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
7162026-06-23T22:57:30.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7172026-06-23T22:57:30.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7182026-06-23T22:57:30.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7192026-06-23T22:57:30.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7202026-06-23T22:57:30.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7212026-06-23T22:57:30.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7222026-06-23T22:57:31.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7232026-06-23T22:57:31.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7242026-06-23T22:57:31.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7252026-06-23T22:57:31.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7262026-06-23T22:57:31.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7272026-06-23T22:57:31.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7282026-06-23T22:57:32.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7292026-06-23T22:57:32.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7302026-06-23T22:57:32.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7312026-06-23T22:57:32.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7322026-06-23T22:57:32.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7332026-06-23T22:57:32.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7342026-06-23T22:57:33.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7352026-06-23T22:57:33.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7362026-06-23T22:57:33.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7372026-06-23T22:57:33.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7382026-06-23T22:57:33.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7392026-06-23T22:57:33.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7402026-06-23T22:57:34.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7412026-06-23T22:57:34.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7422026-06-23T22:57:34.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
7432026-06-23T22:57:34.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
7442026-06-23T22:57:34.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7452026-06-23T22:57:34.665ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
7462026-06-23T22:57:34.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7472026-06-23T22:57:34.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7482026-06-23T22:57:34.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
7492026-06-23T22:57:34.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
7502026-06-23T22:57:34.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7512026-06-23T22:57:34.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
7522026-06-23T22:57:34.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 301
7532026-06-23T22:57:34.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 301
7542026-06-23T22:57:34.890ZDEBGoximeter (clickhouse-client): unrolling 301 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
7552026-06-23T22:57:34.900ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
7562026-06-23T22:57:34.912ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 280 table_name = fields_i16
7572026-06-23T22:57:34.914ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 797 table_name = fields_string
7582026-06-23T22:57:34.915ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 151 table_name = fields_u16
7592026-06-23T22:57:34.916ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 145 table_name = fields_u32
7602026-06-23T22:57:34.918ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 144 table_name = fields_u8
7612026-06-23T22:57:34.919ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 491 table_name = fields_uuid
7622026-06-23T22:57:34.920ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 4 table_name = measurements_bool
7632026-06-23T22:57:34.921ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 215 table_name = measurements_cumulativeu64
7642026-06-23T22:57:34.922ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1 table_name = measurements_f64
7652026-06-23T22:57:34.924ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
7662026-06-23T22:57:34.925ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 70 table_name = measurements_u64
7672026-06-23T22:57:34.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
7682026-06-23T22:57:35.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7692026-06-23T22:57:35.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7702026-06-23T22:57:35.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7712026-06-23T22:57:35.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7722026-06-23T22:57:35.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7732026-06-23T22:57:35.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7742026-06-23T22:57:36.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7752026-06-23T22:57:36.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7762026-06-23T22:57:36.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7772026-06-23T22:57:36.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7782026-06-23T22:57:36.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7792026-06-23T22:57:36.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7802026-06-23T22:57:37.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7812026-06-23T22:57:37.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7822026-06-23T22:57:37.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7832026-06-23T22:57:37.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7842026-06-23T22:57:37.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7852026-06-23T22:57:37.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7862026-06-23T22:57:38.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7872026-06-23T22:57:38.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7882026-06-23T22:57:38.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7892026-06-23T22:57:38.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7902026-06-23T22:57:38.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7912026-06-23T22:57:38.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7922026-06-23T22:57:39.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7932026-06-23T22:57:39.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7942026-06-23T22:57:39.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
7952026-06-23T22:57:39.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
7962026-06-23T22:57:39.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7972026-06-23T22:57:39.658ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
7982026-06-23T22:57:39.665ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
7992026-06-23T22:57:39.665ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
8002026-06-23T22:57:39.665ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
8012026-06-23T22:57:39.665ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
8022026-06-23T22:57:39.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
8032026-06-23T22:57:39.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
8042026-06-23T22:57:39.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8052026-06-23T22:57:39.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8062026-06-23T22:57:39.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8072026-06-23T22:57:39.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 181
8082026-06-23T22:57:39.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 181
8092026-06-23T22:57:39.891ZDEBGoximeter (clickhouse-client): unrolling 181 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
8102026-06-23T22:57:39.897ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
8112026-06-23T22:57:39.903ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 116 table_name = fields_string
8122026-06-23T22:57:39.904ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = fields_u16
8132026-06-23T22:57:39.906ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 91 table_name = fields_uuid
8142026-06-23T22:57:39.907ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 110 table_name = measurements_cumulativeu64
8152026-06-23T22:57:39.909ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = measurements_histogramu64
8162026-06-23T22:57:39.910ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 40 table_name = measurements_u64
8172026-06-23T22:57:39.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
8182026-06-23T22:57:40.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8192026-06-23T22:57:40.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8202026-06-23T22:57:40.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8212026-06-23T22:57:40.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8222026-06-23T22:57:40.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8232026-06-23T22:57:40.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8242026-06-23T22:57:41.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8252026-06-23T22:57:41.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8262026-06-23T22:57:41.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8272026-06-23T22:57:41.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8282026-06-23T22:57:41.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8292026-06-23T22:57:41.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8302026-06-23T22:57:42.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8312026-06-23T22:57:42.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8322026-06-23T22:57:42.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8332026-06-23T22:57:42.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8342026-06-23T22:57:42.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8352026-06-23T22:57:42.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8362026-06-23T22:57:43.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8372026-06-23T22:57:43.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8382026-06-23T22:57:43.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8392026-06-23T22:57:43.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8402026-06-23T22:57:43.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8412026-06-23T22:57:43.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8422026-06-23T22:57:44.646ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
8432026-06-23T22:57:44.646ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending
8442026-06-23T22:57:44.651ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae9a2831-d99e-4939-a6f7-a4d885ed08b2", "content-length": "1276", "date": "Tue, 23 Jun 2026 22:57:44 GMT"} })
8452026-06-23T22:57:44.651ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D
8462026-06-23T22:57:44.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8472026-06-23T22:57:44.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8482026-06-23T22:57:44.654ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
8492026-06-23T22:57:44.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
8502026-06-23T22:57:44.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
8512026-06-23T22:57:44.655ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "b33164bf-5ca8-4a56-9e96-79b2b2b56560", "content-length": "29", "date": "Tue, 23 Jun 2026 22:57:44 GMT"} })
8522026-06-23T22:57:44.655ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 8 n_pruned_tasks = 0
8532026-06-23T22:57:44.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8542026-06-23T22:57:44.665ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
8552026-06-23T22:57:44.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8562026-06-23T22:57:44.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8572026-06-23T22:57:44.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
8582026-06-23T22:57:44.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
8592026-06-23T22:57:44.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8602026-06-23T22:57:44.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
8612026-06-23T22:57:44.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 302
8622026-06-23T22:57:44.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 302
8632026-06-23T22:57:44.890ZDEBGoximeter (clickhouse-client): unrolling 302 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
8642026-06-23T22:57:44.900ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
8652026-06-23T22:57:44.910ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 280 table_name = fields_i16
8662026-06-23T22:57:44.911ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 2 table_name = fields_ipaddr
8672026-06-23T22:57:44.913ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 798 table_name = fields_string
8682026-06-23T22:57:44.914ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 153 table_name = fields_u16
8692026-06-23T22:57:44.915ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 145 table_name = fields_u32
8702026-06-23T22:57:44.917ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 144 table_name = fields_u8
8712026-06-23T22:57:44.918ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 493 table_name = fields_uuid
8722026-06-23T22:57:44.919ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 4 table_name = measurements_bool
8732026-06-23T22:57:44.920ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 216 table_name = measurements_cumulativeu64
8742026-06-23T22:57:44.922ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1 table_name = measurements_f64
8752026-06-23T22:57:44.923ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
8762026-06-23T22:57:44.924ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 70 table_name = measurements_u64
8772026-06-23T22:57:44.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
8782026-06-23T22:57:45.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8792026-06-23T22:57:45.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8802026-06-23T22:57:45.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8812026-06-23T22:57:45.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8822026-06-23T22:57:45.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8832026-06-23T22:57:45.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8842026-06-23T22:57:46.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8852026-06-23T22:57:46.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8862026-06-23T22:57:46.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8872026-06-23T22:57:46.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8882026-06-23T22:57:46.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8892026-06-23T22:57:46.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8902026-06-23T22:57:47.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8912026-06-23T22:57:47.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8922026-06-23T22:57:47.658ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8932026-06-23T22:57:47.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8942026-06-23T22:57:47.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8952026-06-23T22:57:47.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8962026-06-23T22:57:48.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8972026-06-23T22:57:48.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8982026-06-23T22:57:48.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8992026-06-23T22:57:48.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9002026-06-23T22:57:48.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9012026-06-23T22:57:48.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9022026-06-23T22:57:49.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9032026-06-23T22:57:49.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9042026-06-23T22:57:49.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
9052026-06-23T22:57:49.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
9062026-06-23T22:57:49.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9072026-06-23T22:57:49.658ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
9082026-06-23T22:57:49.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
9092026-06-23T22:57:49.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
9102026-06-23T22:57:49.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
9112026-06-23T22:57:49.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
9122026-06-23T22:57:49.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
9132026-06-23T22:57:49.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
9142026-06-23T22:57:49.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9152026-06-23T22:57:49.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9162026-06-23T22:57:49.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9172026-06-23T22:57:49.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 181
9182026-06-23T22:57:49.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 181
9192026-06-23T22:57:49.891ZDEBGoximeter (clickhouse-client): unrolling 181 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
9202026-06-23T22:57:49.899ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
9212026-06-23T22:57:49.905ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 116 table_name = fields_string
9222026-06-23T22:57:49.907ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = fields_u16
9232026-06-23T22:57:49.908ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 91 table_name = fields_uuid
9242026-06-23T22:57:49.910ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 110 table_name = measurements_cumulativeu64
9252026-06-23T22:57:49.913ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = measurements_histogramu64
9262026-06-23T22:57:49.915ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 40 table_name = measurements_u64
9272026-06-23T22:57:49.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
9282026-06-23T22:57:50.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9292026-06-23T22:57:50.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9302026-06-23T22:57:50.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9312026-06-23T22:57:50.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9322026-06-23T22:57:50.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9332026-06-23T22:57:50.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9342026-06-23T22:57:51.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9352026-06-23T22:57:51.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9362026-06-23T22:57:51.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9372026-06-23T22:57:51.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9382026-06-23T22:57:51.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9392026-06-23T22:57:51.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9402026-06-23T22:57:52.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9412026-06-23T22:57:52.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9422026-06-23T22:57:52.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9432026-06-23T22:57:52.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9442026-06-23T22:57:52.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9452026-06-23T22:57:52.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9462026-06-23T22:57:53.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9472026-06-23T22:57:53.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9482026-06-23T22:57:53.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9492026-06-23T22:57:53.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9502026-06-23T22:57:53.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9512026-06-23T22:57:53.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9522026-06-23T22:57:54.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9532026-06-23T22:57:54.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9542026-06-23T22:57:54.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
9552026-06-23T22:57:54.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
9562026-06-23T22:57:54.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9572026-06-23T22:57:54.665ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
9582026-06-23T22:57:54.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9592026-06-23T22:57:54.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9602026-06-23T22:57:54.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
9612026-06-23T22:57:54.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
9622026-06-23T22:57:54.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9632026-06-23T22:57:54.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
9642026-06-23T22:57:54.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 301
9652026-06-23T22:57:54.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 301
9662026-06-23T22:57:54.891ZDEBGoximeter (clickhouse-client): unrolling 301 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
9672026-06-23T22:57:54.901ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
9682026-06-23T22:57:54.910ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 280 table_name = fields_i16
9692026-06-23T22:57:54.911ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 797 table_name = fields_string
9702026-06-23T22:57:54.913ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 151 table_name = fields_u16
9712026-06-23T22:57:54.914ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 145 table_name = fields_u32
9722026-06-23T22:57:54.915ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 144 table_name = fields_u8
9732026-06-23T22:57:54.917ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 491 table_name = fields_uuid
9742026-06-23T22:57:54.918ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 4 table_name = measurements_bool
9752026-06-23T22:57:54.919ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 215 table_name = measurements_cumulativeu64
9762026-06-23T22:57:54.920ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1 table_name = measurements_f64
9772026-06-23T22:57:54.922ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
9782026-06-23T22:57:54.923ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 70 table_name = measurements_u64
9792026-06-23T22:57:54.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
9802026-06-23T22:57:55.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9812026-06-23T22:57:55.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9822026-06-23T22:57:55.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9832026-06-23T22:57:55.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9842026-06-23T22:57:55.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9852026-06-23T22:57:55.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9862026-06-23T22:57:56.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9872026-06-23T22:57:56.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9882026-06-23T22:57:56.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9892026-06-23T22:57:56.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9902026-06-23T22:57:56.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9912026-06-23T22:57:56.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9922026-06-23T22:57:57.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9932026-06-23T22:57:57.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9942026-06-23T22:57:57.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9952026-06-23T22:57:57.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9962026-06-23T22:57:57.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9972026-06-23T22:57:57.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9982026-06-23T22:57:58.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9992026-06-23T22:57:58.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10002026-06-23T22:57:58.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10012026-06-23T22:57:58.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10022026-06-23T22:57:58.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10032026-06-23T22:57:58.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10042026-06-23T22:57:59.645ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
10052026-06-23T22:57:59.645ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending
10062026-06-23T22:57:59.650ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a0bf0be-7443-4c08-8abb-47bdcd876826", "content-length": "1276", "date": "Tue, 23 Jun 2026 22:57:59 GMT"} })
10072026-06-23T22:57:59.650ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D
10082026-06-23T22:57:59.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10092026-06-23T22:57:59.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10102026-06-23T22:57:59.653ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a32966f-224b-4797-840f-663db0986a8e", "content-length": "29", "date": "Tue, 23 Jun 2026 22:57:59 GMT"} })
10112026-06-23T22:57:59.653ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 8 n_pruned_tasks = 0
10122026-06-23T22:57:59.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
10132026-06-23T22:57:59.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
10142026-06-23T22:57:59.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10152026-06-23T22:57:59.658ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
10162026-06-23T22:57:59.666ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
10172026-06-23T22:57:59.666ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
10182026-06-23T22:57:59.666ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
10192026-06-23T22:57:59.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
10202026-06-23T22:57:59.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
10212026-06-23T22:57:59.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
10222026-06-23T22:57:59.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
10232026-06-23T22:57:59.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
10242026-06-23T22:57:59.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
10252026-06-23T22:57:59.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
10262026-06-23T22:57:59.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
10272026-06-23T22:57:59.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10282026-06-23T22:57:59.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10292026-06-23T22:57:59.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10302026-06-23T22:57:59.743ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 1844 producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
10312026-06-23T22:57:59.747ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 2028
10322026-06-23T22:57:59.747ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 2028
10332026-06-23T22:57:59.747ZDEBGoximeter (clickhouse-client): unrolling 2028 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
10342026-06-23T22:57:59.806ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
10352026-06-23T22:57:59.825ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 6 table_name = fields_ipaddr
10362026-06-23T22:57:59.828ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 3322 table_name = fields_string
10372026-06-23T22:57:59.829ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 46 table_name = fields_u16
10382026-06-23T22:57:59.831ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 953 table_name = fields_u32
10392026-06-23T22:57:59.833ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1903 table_name = fields_uuid
10402026-06-23T22:57:59.835ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1796 table_name = measurements_cumulativeu64
10412026-06-23T22:57:59.837ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 40 table_name = measurements_histogramu64
10422026-06-23T22:57:59.838ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 192 table_name = measurements_u64
10432026-06-23T22:57:59.847ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
10442026-06-23T22:57:59.890ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
10452026-06-23T22:57:59.890ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
10462026-06-23T22:58:00.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10472026-06-23T22:58:00.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10482026-06-23T22:58:00.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10492026-06-23T22:58:00.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10502026-06-23T22:58:00.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10512026-06-23T22:58:00.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10522026-06-23T22:58:01.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10532026-06-23T22:58:01.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10542026-06-23T22:58:01.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10552026-06-23T22:58:01.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10562026-06-23T22:58:01.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10572026-06-23T22:58:01.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10582026-06-23T22:58:02.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10592026-06-23T22:58:02.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10602026-06-23T22:58:02.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10612026-06-23T22:58:02.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10622026-06-23T22:58:02.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10632026-06-23T22:58:02.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10642026-06-23T22:58:03.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10652026-06-23T22:58:03.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10662026-06-23T22:58:03.655ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10672026-06-23T22:58:03.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10682026-06-23T22:58:03.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10692026-06-23T22:58:03.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10702026-06-23T22:58:04.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10712026-06-23T22:58:04.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10722026-06-23T22:58:04.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
10732026-06-23T22:58:04.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
10742026-06-23T22:58:04.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10752026-06-23T22:58:04.665ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
10762026-06-23T22:58:04.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10772026-06-23T22:58:04.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
10782026-06-23T22:58:04.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10792026-06-23T22:58:04.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
10802026-06-23T22:58:04.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10812026-06-23T22:58:04.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
10822026-06-23T22:58:04.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 301
10832026-06-23T22:58:04.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 301
10842026-06-23T22:58:04.891ZDEBGoximeter (clickhouse-client): unrolling 301 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
10852026-06-23T22:58:04.901ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
10862026-06-23T22:58:04.909ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 280 table_name = fields_i16
10872026-06-23T22:58:04.911ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 797 table_name = fields_string
10882026-06-23T22:58:04.912ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 151 table_name = fields_u16
10892026-06-23T22:58:04.913ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 145 table_name = fields_u32
10902026-06-23T22:58:04.915ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 144 table_name = fields_u8
10912026-06-23T22:58:04.916ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 491 table_name = fields_uuid
10922026-06-23T22:58:04.917ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 4 table_name = measurements_bool
10932026-06-23T22:58:04.918ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 215 table_name = measurements_cumulativeu64
10942026-06-23T22:58:04.920ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1 table_name = measurements_f64
10952026-06-23T22:58:04.921ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
10962026-06-23T22:58:04.922ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 70 table_name = measurements_u64
10972026-06-23T22:58:04.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
10982026-06-23T22:58:05.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10992026-06-23T22:58:05.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11002026-06-23T22:58:05.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11012026-06-23T22:58:05.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11022026-06-23T22:58:05.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11032026-06-23T22:58:05.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11042026-06-23T22:58:06.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11052026-06-23T22:58:06.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11062026-06-23T22:58:06.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11072026-06-23T22:58:06.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11082026-06-23T22:58:06.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11092026-06-23T22:58:06.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11102026-06-23T22:58:07.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11112026-06-23T22:58:07.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11122026-06-23T22:58:07.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11132026-06-23T22:58:07.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11142026-06-23T22:58:07.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11152026-06-23T22:58:07.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11162026-06-23T22:58:08.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11172026-06-23T22:58:08.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11182026-06-23T22:58:08.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11192026-06-23T22:58:08.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11202026-06-23T22:58:08.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11212026-06-23T22:58:08.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11222026-06-23T22:58:09.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11232026-06-23T22:58:09.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11242026-06-23T22:58:09.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
11252026-06-23T22:58:09.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
11262026-06-23T22:58:09.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11272026-06-23T22:58:09.658ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
11282026-06-23T22:58:09.665ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
11292026-06-23T22:58:09.665ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
11302026-06-23T22:58:09.665ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
11312026-06-23T22:58:09.665ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
11322026-06-23T22:58:09.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
11332026-06-23T22:58:09.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
11342026-06-23T22:58:09.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11352026-06-23T22:58:09.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11362026-06-23T22:58:09.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11372026-06-23T22:58:09.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 181
11382026-06-23T22:58:09.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 181
11392026-06-23T22:58:09.891ZDEBGoximeter (clickhouse-client): unrolling 181 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
11402026-06-23T22:58:09.896ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
11412026-06-23T22:58:09.903ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 116 table_name = fields_string
11422026-06-23T22:58:09.904ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = fields_u16
11432026-06-23T22:58:09.905ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 91 table_name = fields_uuid
11442026-06-23T22:58:09.907ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 110 table_name = measurements_cumulativeu64
11452026-06-23T22:58:09.908ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = measurements_histogramu64
11462026-06-23T22:58:09.910ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 40 table_name = measurements_u64
11472026-06-23T22:58:09.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
11482026-06-23T22:58:10.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11492026-06-23T22:58:10.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11502026-06-23T22:58:10.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11512026-06-23T22:58:10.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11522026-06-23T22:58:10.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11532026-06-23T22:58:10.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11542026-06-23T22:58:11.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11552026-06-23T22:58:11.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11562026-06-23T22:58:11.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11572026-06-23T22:58:11.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11582026-06-23T22:58:11.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11592026-06-23T22:58:11.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11602026-06-23T22:58:12.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11612026-06-23T22:58:12.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11622026-06-23T22:58:12.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11632026-06-23T22:58:12.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11642026-06-23T22:58:12.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11652026-06-23T22:58:12.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11662026-06-23T22:58:13.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11672026-06-23T22:58:13.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11682026-06-23T22:58:13.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11692026-06-23T22:58:13.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11702026-06-23T22:58:13.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11712026-06-23T22:58:13.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11722026-06-23T22:58:14.645ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
11732026-06-23T22:58:14.645ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending
11742026-06-23T22:58:14.650ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7ec17a5-8a5c-4c06-9b2a-256ea72864de", "content-length": "1276", "date": "Tue, 23 Jun 2026 22:58:14 GMT"} })
11752026-06-23T22:58:14.650ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D
11762026-06-23T22:58:14.652ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7912448-71fb-4a49-89f5-9f0ce3603351", "content-length": "29", "date": "Tue, 23 Jun 2026 22:58:14 GMT"} })
11772026-06-23T22:58:14.652ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 8 n_pruned_tasks = 0
11782026-06-23T22:58:14.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11792026-06-23T22:58:14.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11802026-06-23T22:58:14.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
11812026-06-23T22:58:14.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
11822026-06-23T22:58:14.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11832026-06-23T22:58:14.660ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
11842026-06-23T22:58:14.660ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11852026-06-23T22:58:14.665ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
11862026-06-23T22:58:14.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11872026-06-23T22:58:14.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11882026-06-23T22:58:14.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
11892026-06-23T22:58:14.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
11902026-06-23T22:58:14.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11912026-06-23T22:58:14.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
11922026-06-23T22:58:14.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 303
11932026-06-23T22:58:14.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 303
11942026-06-23T22:58:14.891ZDEBGoximeter (clickhouse-client): unrolling 303 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
11952026-06-23T22:58:14.901ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
11962026-06-23T22:58:14.910ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 280 table_name = fields_i16
11972026-06-23T22:58:14.911ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 4 table_name = fields_ipaddr
11982026-06-23T22:58:14.913ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 799 table_name = fields_string
11992026-06-23T22:58:14.915ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 155 table_name = fields_u16
12002026-06-23T22:58:14.916ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 145 table_name = fields_u32
12012026-06-23T22:58:14.917ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 144 table_name = fields_u8
12022026-06-23T22:58:14.919ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 495 table_name = fields_uuid
12032026-06-23T22:58:14.920ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 4 table_name = measurements_bool
12042026-06-23T22:58:14.921ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 217 table_name = measurements_cumulativeu64
12052026-06-23T22:58:14.923ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1 table_name = measurements_f64
12062026-06-23T22:58:14.924ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
12072026-06-23T22:58:14.926ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 70 table_name = measurements_u64
12082026-06-23T22:58:14.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
12092026-06-23T22:58:15.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12102026-06-23T22:58:15.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12112026-06-23T22:58:15.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12122026-06-23T22:58:15.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12132026-06-23T22:58:15.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12142026-06-23T22:58:15.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12152026-06-23T22:58:16.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12162026-06-23T22:58:16.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12172026-06-23T22:58:16.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12182026-06-23T22:58:16.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12192026-06-23T22:58:16.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12202026-06-23T22:58:16.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12212026-06-23T22:58:17.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12222026-06-23T22:58:17.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12232026-06-23T22:58:17.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12242026-06-23T22:58:17.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12252026-06-23T22:58:17.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12262026-06-23T22:58:17.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12272026-06-23T22:58:18.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12282026-06-23T22:58:18.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12292026-06-23T22:58:18.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12302026-06-23T22:58:18.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12312026-06-23T22:58:18.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12322026-06-23T22:58:18.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12332026-06-23T22:58:19.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12342026-06-23T22:58:19.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12352026-06-23T22:58:19.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
12362026-06-23T22:58:19.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
12372026-06-23T22:58:19.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12382026-06-23T22:58:19.658ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
12392026-06-23T22:58:19.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
12402026-06-23T22:58:19.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
12412026-06-23T22:58:19.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
12422026-06-23T22:58:19.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
12432026-06-23T22:58:19.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
12442026-06-23T22:58:19.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
12452026-06-23T22:58:19.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12462026-06-23T22:58:19.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12472026-06-23T22:58:19.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12482026-06-23T22:58:19.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 181
12492026-06-23T22:58:19.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 181
12502026-06-23T22:58:19.891ZDEBGoximeter (clickhouse-client): unrolling 181 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
12512026-06-23T22:58:19.897ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
12522026-06-23T22:58:19.903ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 116 table_name = fields_string
12532026-06-23T22:58:19.904ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = fields_u16
12542026-06-23T22:58:19.906ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 91 table_name = fields_uuid
12552026-06-23T22:58:19.907ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 110 table_name = measurements_cumulativeu64
12562026-06-23T22:58:19.909ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = measurements_histogramu64
12572026-06-23T22:58:19.911ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 40 table_name = measurements_u64
12582026-06-23T22:58:19.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
12592026-06-23T22:58:20.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12602026-06-23T22:58:20.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12612026-06-23T22:58:20.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12622026-06-23T22:58:20.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12632026-06-23T22:58:20.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12642026-06-23T22:58:20.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12652026-06-23T22:58:21.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12662026-06-23T22:58:21.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12672026-06-23T22:58:21.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12682026-06-23T22:58:21.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12692026-06-23T22:58:21.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12702026-06-23T22:58:21.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12712026-06-23T22:58:22.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12722026-06-23T22:58:22.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12732026-06-23T22:58:22.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12742026-06-23T22:58:22.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12752026-06-23T22:58:22.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12762026-06-23T22:58:22.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12772026-06-23T22:58:23.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12782026-06-23T22:58:23.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12792026-06-23T22:58:23.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12802026-06-23T22:58:23.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12812026-06-23T22:58:23.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12822026-06-23T22:58:23.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12832026-06-23T22:58:24.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12842026-06-23T22:58:24.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12852026-06-23T22:58:24.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
12862026-06-23T22:58:24.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
12872026-06-23T22:58:24.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12882026-06-23T22:58:24.665ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
12892026-06-23T22:58:24.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12902026-06-23T22:58:24.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
12912026-06-23T22:58:24.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
12922026-06-23T22:58:24.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12932026-06-23T22:58:24.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12942026-06-23T22:58:24.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
12952026-06-23T22:58:24.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 301
12962026-06-23T22:58:24.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 301
12972026-06-23T22:58:24.891ZDEBGoximeter (clickhouse-client): unrolling 301 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
12982026-06-23T22:58:24.901ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
12992026-06-23T22:58:24.910ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 280 table_name = fields_i16
13002026-06-23T22:58:24.912ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 797 table_name = fields_string
13012026-06-23T22:58:24.913ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 151 table_name = fields_u16
13022026-06-23T22:58:24.914ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 145 table_name = fields_u32
13032026-06-23T22:58:24.916ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 144 table_name = fields_u8
13042026-06-23T22:58:24.917ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 491 table_name = fields_uuid
13052026-06-23T22:58:24.918ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 4 table_name = measurements_bool
13062026-06-23T22:58:24.919ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 215 table_name = measurements_cumulativeu64
13072026-06-23T22:58:24.920ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1 table_name = measurements_f64
13082026-06-23T22:58:24.922ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
13092026-06-23T22:58:24.923ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 70 table_name = measurements_u64
13102026-06-23T22:58:24.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
13112026-06-23T22:58:25.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13122026-06-23T22:58:25.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13132026-06-23T22:58:25.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13142026-06-23T22:58:25.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13152026-06-23T22:58:25.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13162026-06-23T22:58:25.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13172026-06-23T22:58:26.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13182026-06-23T22:58:26.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13192026-06-23T22:58:26.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13202026-06-23T22:58:26.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13212026-06-23T22:58:26.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13222026-06-23T22:58:26.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13232026-06-23T22:58:27.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13242026-06-23T22:58:27.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13252026-06-23T22:58:27.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13262026-06-23T22:58:27.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13272026-06-23T22:58:27.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13282026-06-23T22:58:27.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13292026-06-23T22:58:28.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13302026-06-23T22:58:28.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13312026-06-23T22:58:28.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13322026-06-23T22:58:28.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13332026-06-23T22:58:28.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13342026-06-23T22:58:28.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13352026-06-23T22:58:29.645ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
13362026-06-23T22:58:29.645ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending
13372026-06-23T22:58:29.650ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "80a265ba-d792-42a0-98fd-deda403ab0f9", "content-length": "1412", "date": "Tue, 23 Jun 2026 22:58:29 GMT"} })
13382026-06-23T22:58:29.650ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D
13392026-06-23T22:58:29.654ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13402026-06-23T22:58:29.654ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "6192c0b4-323b-41bf-9a44-db0081a29797", "content-length": "29", "date": "Tue, 23 Jun 2026 22:58:29 GMT"} })
13412026-06-23T22:58:29.654ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab
13422026-06-23T22:58:29.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13432026-06-23T22:58:29.654ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 9 n_pruned_tasks = 0
13442026-06-23T22:58:29.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13452026-06-23T22:58:29.655ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13462026-06-23T22:58:29.655ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
13472026-06-23T22:58:29.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13482026-06-23T22:58:29.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13492026-06-23T22:58:29.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
13502026-06-23T22:58:29.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
13512026-06-23T22:58:29.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13522026-06-23T22:58:29.658ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
13532026-06-23T22:58:29.662ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13542026-06-23T22:58:29.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
13552026-06-23T22:58:29.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
13562026-06-23T22:58:29.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
13572026-06-23T22:58:29.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
13582026-06-23T22:58:29.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
13592026-06-23T22:58:29.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
13602026-06-23T22:58:29.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
13612026-06-23T22:58:29.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
13622026-06-23T22:58:29.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13632026-06-23T22:58:29.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13642026-06-23T22:58:29.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13652026-06-23T22:58:29.738ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 1692 producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
13662026-06-23T22:58:29.741ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 1890
13672026-06-23T22:58:29.742ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 1890
13682026-06-23T22:58:29.742ZDEBGoximeter (clickhouse-client): unrolling 1890 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
13692026-06-23T22:58:29.794ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
13702026-06-23T22:58:29.813ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 6 table_name = fields_ipaddr
13712026-06-23T22:58:29.816ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 2488 table_name = fields_string
13722026-06-23T22:58:29.817ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 46 table_name = fields_u16
13732026-06-23T22:58:29.818ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 801 table_name = fields_u32
13742026-06-23T22:58:29.820ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1349 table_name = fields_uuid
13752026-06-23T22:58:29.822ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1806 table_name = measurements_cumulativeu64
13762026-06-23T22:58:29.824ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 40 table_name = measurements_histogramu64
13772026-06-23T22:58:29.825ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 44 table_name = measurements_u64
13782026-06-23T22:58:29.843ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
13792026-06-23T22:58:29.891ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
13802026-06-23T22:58:29.891ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
13812026-06-23T22:58:30.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13822026-06-23T22:58:30.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13832026-06-23T22:58:30.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13842026-06-23T22:58:30.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13852026-06-23T22:58:30.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13862026-06-23T22:58:30.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13872026-06-23T22:58:30.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13882026-06-23T22:58:30.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13892026-06-23T22:58:30.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13902026-06-23T22:58:31.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13912026-06-23T22:58:31.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13922026-06-23T22:58:31.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13932026-06-23T22:58:31.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13942026-06-23T22:58:31.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
13952026-06-23T22:58:31.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
13962026-06-23T22:58:31.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13972026-06-23T22:58:31.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13982026-06-23T22:58:31.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
13992026-06-23T22:58:32.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14002026-06-23T22:58:32.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14012026-06-23T22:58:32.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14022026-06-23T22:58:32.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14032026-06-23T22:58:32.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14042026-06-23T22:58:32.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14052026-06-23T22:58:32.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14062026-06-23T22:58:32.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14072026-06-23T22:58:32.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14082026-06-23T22:58:33.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14092026-06-23T22:58:33.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14102026-06-23T22:58:33.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14112026-06-23T22:58:33.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14122026-06-23T22:58:33.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14132026-06-23T22:58:33.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14142026-06-23T22:58:33.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14152026-06-23T22:58:33.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14162026-06-23T22:58:33.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14172026-06-23T22:58:34.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14182026-06-23T22:58:34.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14192026-06-23T22:58:34.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
14202026-06-23T22:58:34.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
14212026-06-23T22:58:34.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14222026-06-23T22:58:34.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14232026-06-23T22:58:34.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14242026-06-23T22:58:34.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14252026-06-23T22:58:34.665ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
14262026-06-23T22:58:34.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14272026-06-23T22:58:34.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
14282026-06-23T22:58:34.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14292026-06-23T22:58:34.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
14302026-06-23T22:58:34.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14312026-06-23T22:58:34.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
14322026-06-23T22:58:34.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 371
14332026-06-23T22:58:34.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 371
14342026-06-23T22:58:34.891ZDEBGoximeter (clickhouse-client): unrolling 371 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
14352026-06-23T22:58:34.902ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
14362026-06-23T22:58:34.912ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 280 table_name = fields_i16
14372026-06-23T22:58:34.913ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 823 table_name = fields_string
14382026-06-23T22:58:34.915ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 151 table_name = fields_u16
14392026-06-23T22:58:34.916ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 145 table_name = fields_u32
14402026-06-23T22:58:34.917ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 144 table_name = fields_u8
14412026-06-23T22:58:34.918ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 519 table_name = fields_uuid
14422026-06-23T22:58:34.920ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 4 table_name = measurements_bool
14432026-06-23T22:58:34.921ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 265 table_name = measurements_cumulativeu64
14442026-06-23T22:58:34.922ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1 table_name = measurements_f64
14452026-06-23T22:58:34.924ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
14462026-06-23T22:58:34.925ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 90 table_name = measurements_u64
14472026-06-23T22:58:34.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
14482026-06-23T22:58:35.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14492026-06-23T22:58:35.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14502026-06-23T22:58:35.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14512026-06-23T22:58:35.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14522026-06-23T22:58:35.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14532026-06-23T22:58:35.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14542026-06-23T22:58:35.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14552026-06-23T22:58:35.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14562026-06-23T22:58:35.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14572026-06-23T22:58:36.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14582026-06-23T22:58:36.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14592026-06-23T22:58:36.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14602026-06-23T22:58:36.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14612026-06-23T22:58:36.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14622026-06-23T22:58:36.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14632026-06-23T22:58:36.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14642026-06-23T22:58:36.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14652026-06-23T22:58:36.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14662026-06-23T22:58:37.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14672026-06-23T22:58:37.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14682026-06-23T22:58:37.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14692026-06-23T22:58:37.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14702026-06-23T22:58:37.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14712026-06-23T22:58:37.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14722026-06-23T22:58:37.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14732026-06-23T22:58:37.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14742026-06-23T22:58:37.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14752026-06-23T22:58:38.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14762026-06-23T22:58:38.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14772026-06-23T22:58:38.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14782026-06-23T22:58:38.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14792026-06-23T22:58:38.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14802026-06-23T22:58:38.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14812026-06-23T22:58:38.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14822026-06-23T22:58:38.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14832026-06-23T22:58:38.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
14842026-06-23T22:58:39.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14852026-06-23T22:58:39.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14862026-06-23T22:58:39.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14872026-06-23T22:58:39.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
14882026-06-23T22:58:39.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
14892026-06-23T22:58:39.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14902026-06-23T22:58:39.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
14912026-06-23T22:58:39.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
14922026-06-23T22:58:39.658ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
14932026-06-23T22:58:39.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
14942026-06-23T22:58:39.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
14952026-06-23T22:58:39.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
14962026-06-23T22:58:39.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
14972026-06-23T22:58:39.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
14982026-06-23T22:58:39.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
14992026-06-23T22:58:39.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15002026-06-23T22:58:39.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15012026-06-23T22:58:39.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15022026-06-23T22:58:39.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 251
15032026-06-23T22:58:39.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 251
15042026-06-23T22:58:39.891ZDEBGoximeter (clickhouse-client): unrolling 251 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
15052026-06-23T22:58:39.899ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
15062026-06-23T22:58:39.906ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 142 table_name = fields_string
15072026-06-23T22:58:39.907ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = fields_u16
15082026-06-23T22:58:39.908ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 119 table_name = fields_uuid
15092026-06-23T22:58:39.910ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 160 table_name = measurements_cumulativeu64
15102026-06-23T22:58:39.912ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = measurements_histogramu64
15112026-06-23T22:58:39.913ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 60 table_name = measurements_u64
15122026-06-23T22:58:39.993ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
15132026-06-23T22:58:40.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15142026-06-23T22:58:40.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15152026-06-23T22:58:40.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15162026-06-23T22:58:40.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15172026-06-23T22:58:40.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15182026-06-23T22:58:40.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15192026-06-23T22:58:40.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15202026-06-23T22:58:40.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15212026-06-23T22:58:40.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15222026-06-23T22:58:41.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15232026-06-23T22:58:41.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15242026-06-23T22:58:41.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15252026-06-23T22:58:41.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15262026-06-23T22:58:41.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15272026-06-23T22:58:41.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15282026-06-23T22:58:41.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15292026-06-23T22:58:41.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15302026-06-23T22:58:41.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15312026-06-23T22:58:42.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15322026-06-23T22:58:42.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15332026-06-23T22:58:42.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15342026-06-23T22:58:42.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15352026-06-23T22:58:42.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15362026-06-23T22:58:42.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15372026-06-23T22:58:42.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15382026-06-23T22:58:42.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15392026-06-23T22:58:42.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15402026-06-23T22:58:43.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15412026-06-23T22:58:43.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15422026-06-23T22:58:43.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15432026-06-23T22:58:43.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15442026-06-23T22:58:43.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15452026-06-23T22:58:43.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15462026-06-23T22:58:43.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15472026-06-23T22:58:43.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15482026-06-23T22:58:43.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15492026-06-23T22:58:44.646ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
15502026-06-23T22:58:44.646ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending
15512026-06-23T22:58:44.649ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "971c15ea-858b-4a57-abea-e8d1ed1e62a1", "content-length": "1412", "date": "Tue, 23 Jun 2026 22:58:44 GMT"} })
15522026-06-23T22:58:44.650ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D
15532026-06-23T22:58:44.652ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "57f920db-9260-418f-8cd0-06da64691cf9", "content-length": "29", "date": "Tue, 23 Jun 2026 22:58:44 GMT"} })
15542026-06-23T22:58:44.652ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 9 n_pruned_tasks = 0
15552026-06-23T22:58:44.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15562026-06-23T22:58:44.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15572026-06-23T22:58:44.653ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
15582026-06-23T22:58:44.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
15592026-06-23T22:58:44.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
15602026-06-23T22:58:44.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15612026-06-23T22:58:44.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15622026-06-23T22:58:44.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15632026-06-23T22:58:44.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15642026-06-23T22:58:44.664ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
15652026-06-23T22:58:44.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15662026-06-23T22:58:44.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15672026-06-23T22:58:44.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
15682026-06-23T22:58:44.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
15692026-06-23T22:58:44.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15702026-06-23T22:58:44.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
15712026-06-23T22:58:44.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 372
15722026-06-23T22:58:44.891ZDEBGoximeter (clickhouse-client): unrolling 372 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
15732026-06-23T22:58:44.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 372
15742026-06-23T22:58:44.902ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
15752026-06-23T22:58:44.912ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 280 table_name = fields_i16
15762026-06-23T22:58:44.914ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 2 table_name = fields_ipaddr
15772026-06-23T22:58:44.915ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 824 table_name = fields_string
15782026-06-23T22:58:44.916ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 153 table_name = fields_u16
15792026-06-23T22:58:44.918ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 145 table_name = fields_u32
15802026-06-23T22:58:44.919ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 144 table_name = fields_u8
15812026-06-23T22:58:44.921ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 521 table_name = fields_uuid
15822026-06-23T22:58:44.922ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 4 table_name = measurements_bool
15832026-06-23T22:58:44.923ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 266 table_name = measurements_cumulativeu64
15842026-06-23T22:58:44.924ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1 table_name = measurements_f64
15852026-06-23T22:58:44.926ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
15862026-06-23T22:58:44.927ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 90 table_name = measurements_u64
15872026-06-23T22:58:44.991ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
15882026-06-23T22:58:45.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15892026-06-23T22:58:45.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15902026-06-23T22:58:45.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15912026-06-23T22:58:45.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15922026-06-23T22:58:45.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15932026-06-23T22:58:45.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
15942026-06-23T22:58:45.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15952026-06-23T22:58:45.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15962026-06-23T22:58:45.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
15972026-06-23T22:58:46.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15982026-06-23T22:58:46.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
15992026-06-23T22:58:46.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16002026-06-23T22:58:46.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16012026-06-23T22:58:46.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16022026-06-23T22:58:46.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16032026-06-23T22:58:46.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16042026-06-23T22:58:46.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16052026-06-23T22:58:46.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16062026-06-23T22:58:47.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16072026-06-23T22:58:47.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16082026-06-23T22:58:47.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16092026-06-23T22:58:47.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16102026-06-23T22:58:47.658ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16112026-06-23T22:58:47.658ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16122026-06-23T22:58:47.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16132026-06-23T22:58:47.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16142026-06-23T22:58:47.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16152026-06-23T22:58:48.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16162026-06-23T22:58:48.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16172026-06-23T22:58:48.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16182026-06-23T22:58:48.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16192026-06-23T22:58:48.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16202026-06-23T22:58:48.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16212026-06-23T22:58:48.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16222026-06-23T22:58:48.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16232026-06-23T22:58:48.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16242026-06-23T22:58:49.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16252026-06-23T22:58:49.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16262026-06-23T22:58:49.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16272026-06-23T22:58:49.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
16282026-06-23T22:58:49.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16292026-06-23T22:58:49.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
16302026-06-23T22:58:49.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16312026-06-23T22:58:49.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16322026-06-23T22:58:49.658ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
16332026-06-23T22:58:49.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
16342026-06-23T22:58:49.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
16352026-06-23T22:58:49.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
16362026-06-23T22:58:49.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
16372026-06-23T22:58:49.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
16382026-06-23T22:58:49.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
16392026-06-23T22:58:49.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16402026-06-23T22:58:49.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16412026-06-23T22:58:49.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16422026-06-23T22:58:49.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 251
16432026-06-23T22:58:49.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 251
16442026-06-23T22:58:49.891ZDEBGoximeter (clickhouse-client): unrolling 251 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
16452026-06-23T22:58:49.900ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
16462026-06-23T22:58:49.907ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 142 table_name = fields_string
16472026-06-23T22:58:49.908ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = fields_u16
16482026-06-23T22:58:49.909ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 119 table_name = fields_uuid
16492026-06-23T22:58:49.911ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 160 table_name = measurements_cumulativeu64
16502026-06-23T22:58:49.913ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = measurements_histogramu64
16512026-06-23T22:58:49.914ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 60 table_name = measurements_u64
16522026-06-23T22:58:49.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
16532026-06-23T22:58:50.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16542026-06-23T22:58:50.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16552026-06-23T22:58:50.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16562026-06-23T22:58:50.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16572026-06-23T22:58:50.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16582026-06-23T22:58:50.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16592026-06-23T22:58:50.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16602026-06-23T22:58:50.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16612026-06-23T22:58:50.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16622026-06-23T22:58:51.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16632026-06-23T22:58:51.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16642026-06-23T22:58:51.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16652026-06-23T22:58:51.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16662026-06-23T22:58:51.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16672026-06-23T22:58:51.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16682026-06-23T22:58:51.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16692026-06-23T22:58:51.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16702026-06-23T22:58:51.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16712026-06-23T22:58:52.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16722026-06-23T22:58:52.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16732026-06-23T22:58:52.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16742026-06-23T22:58:52.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16752026-06-23T22:58:52.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16762026-06-23T22:58:52.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16772026-06-23T22:58:52.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16782026-06-23T22:58:52.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16792026-06-23T22:58:52.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16802026-06-23T22:58:53.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16812026-06-23T22:58:53.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16822026-06-23T22:58:53.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16832026-06-23T22:58:53.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16842026-06-23T22:58:53.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16852026-06-23T22:58:53.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16862026-06-23T22:58:53.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16872026-06-23T22:58:53.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16882026-06-23T22:58:53.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16892026-06-23T22:58:54.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16902026-06-23T22:58:54.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16912026-06-23T22:58:54.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
16922026-06-23T22:58:54.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
16932026-06-23T22:58:54.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16942026-06-23T22:58:54.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16952026-06-23T22:58:54.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
16962026-06-23T22:58:54.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
16972026-06-23T22:58:54.665ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
16982026-06-23T22:58:54.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
16992026-06-23T22:58:54.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
17002026-06-23T22:58:54.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
17012026-06-23T22:58:54.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
17022026-06-23T22:58:54.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
17032026-06-23T22:58:54.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
17042026-06-23T22:58:54.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 371
17052026-06-23T22:58:54.890ZDEBGoximeter (clickhouse-client): unrolling 371 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
17062026-06-23T22:58:54.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 371
17072026-06-23T22:58:54.902ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
17082026-06-23T22:58:54.911ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 280 table_name = fields_i16
17092026-06-23T22:58:54.913ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 823 table_name = fields_string
17102026-06-23T22:58:54.915ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 151 table_name = fields_u16
17112026-06-23T22:58:54.916ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 145 table_name = fields_u32
17122026-06-23T22:58:54.917ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 144 table_name = fields_u8
17132026-06-23T22:58:54.919ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 519 table_name = fields_uuid
17142026-06-23T22:58:54.920ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 4 table_name = measurements_bool
17152026-06-23T22:58:54.922ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 265 table_name = measurements_cumulativeu64
17162026-06-23T22:58:54.923ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1 table_name = measurements_f64
17172026-06-23T22:58:54.925ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
17182026-06-23T22:58:54.926ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 90 table_name = measurements_u64
17192026-06-23T22:58:54.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
17202026-06-23T22:58:55.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
17212026-06-23T22:58:55.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
17222026-06-23T22:58:55.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
17232026-06-23T22:58:55.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
17242026-06-23T22:58:55.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
17252026-06-23T22:58:55.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
17262026-06-23T22:58:55.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
17272026-06-23T22:58:55.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
17282026-06-23T22:58:55.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
17292026-06-23T22:58:56.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
17302026-06-23T22:58:56.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
17312026-06-23T22:58:56.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
17322026-06-23T22:58:56.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
17332026-06-23T22:58:56.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
17342026-06-23T22:58:56.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
17352026-06-23T22:58:56.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
17362026-06-23T22:58:56.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
17372026-06-23T22:58:56.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
17382026-06-23T22:58:57.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
17392026-06-23T22:58:57.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
17402026-06-23T22:58:57.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
17412026-06-23T22:58:57.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
17422026-06-23T22:58:57.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
17432026-06-23T22:58:57.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
17442026-06-23T22:58:57.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
17452026-06-23T22:58:57.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
17462026-06-23T22:58:57.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
17472026-06-23T22:58:58.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
17482026-06-23T22:58:58.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
17492026-06-23T22:58:58.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
17502026-06-23T22:58:58.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
17512026-06-23T22:58:58.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
17522026-06-23T22:58:58.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
17532026-06-23T22:58:58.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
17542026-06-23T22:58:58.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
17552026-06-23T22:58:58.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
17562026-06-23T22:58:59.646ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
17572026-06-23T22:58:59.646ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending
17582026-06-23T22:58:59.650ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f3ca745-6ca0-40f1-a9e7-01a501d62c1f", "content-length": "1412", "date": "Tue, 23 Jun 2026 22:58:59 GMT"} })
17592026-06-23T22:58:59.650ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D
17602026-06-23T22:58:59.653ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ed17695-8010-4519-87b3-f5d120b32340", "content-length": "29", "date": "Tue, 23 Jun 2026 22:58:59 GMT"} })
17612026-06-23T22:58:59.653ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 9 n_pruned_tasks = 0
17622026-06-23T22:58:59.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
17632026-06-23T22:58:59.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
17642026-06-23T22:58:59.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
17652026-06-23T22:58:59.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
17662026-06-23T22:58:59.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
17672026-06-23T22:58:59.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
17682026-06-23T22:58:59.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
17692026-06-23T22:58:59.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
17702026-06-23T22:58:59.658ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
17712026-06-23T22:58:59.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
17722026-06-23T22:58:59.666ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
17732026-06-23T22:58:59.666ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
17742026-06-23T22:58:59.666ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
17752026-06-23T22:58:59.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
17762026-06-23T22:58:59.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
17772026-06-23T22:58:59.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
17782026-06-23T22:58:59.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
17792026-06-23T22:58:59.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
17802026-06-23T22:58:59.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
17812026-06-23T22:58:59.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
17822026-06-23T22:58:59.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
17832026-06-23T22:58:59.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
17842026-06-23T22:58:59.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
17852026-06-23T22:58:59.743ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 1844 producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
17862026-06-23T22:58:59.747ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 2098
17872026-06-23T22:58:59.747ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 2098
17882026-06-23T22:58:59.747ZDEBGoximeter (clickhouse-client): unrolling 2098 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
17892026-06-23T22:58:59.808ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
17902026-06-23T22:58:59.828ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 6 table_name = fields_ipaddr
17912026-06-23T22:58:59.832ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 3348 table_name = fields_string
17922026-06-23T22:58:59.833ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 46 table_name = fields_u16
17932026-06-23T22:58:59.835ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 953 table_name = fields_u32
17942026-06-23T22:58:59.837ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1931 table_name = fields_uuid
17952026-06-23T22:58:59.839ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1846 table_name = measurements_cumulativeu64
17962026-06-23T22:58:59.841ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 40 table_name = measurements_histogramu64
17972026-06-23T22:58:59.842ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 212 table_name = measurements_u64
17982026-06-23T22:58:59.848ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
17992026-06-23T22:58:59.891ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
18002026-06-23T22:58:59.891ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
18012026-06-23T22:59:00.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18022026-06-23T22:59:00.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18032026-06-23T22:59:00.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18042026-06-23T22:59:00.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18052026-06-23T22:59:00.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18062026-06-23T22:59:00.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18072026-06-23T22:59:00.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18082026-06-23T22:59:00.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18092026-06-23T22:59:00.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18102026-06-23T22:59:01.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18112026-06-23T22:59:01.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18122026-06-23T22:59:01.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18132026-06-23T22:59:01.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18142026-06-23T22:59:01.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18152026-06-23T22:59:01.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18162026-06-23T22:59:01.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18172026-06-23T22:59:01.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18182026-06-23T22:59:01.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18192026-06-23T22:59:02.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18202026-06-23T22:59:02.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18212026-06-23T22:59:02.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18222026-06-23T22:59:02.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18232026-06-23T22:59:02.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18242026-06-23T22:59:02.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18252026-06-23T22:59:02.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18262026-06-23T22:59:02.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18272026-06-23T22:59:02.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18282026-06-23T22:59:03.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18292026-06-23T22:59:03.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18302026-06-23T22:59:03.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18312026-06-23T22:59:03.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18322026-06-23T22:59:03.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18332026-06-23T22:59:03.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18342026-06-23T22:59:03.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18352026-06-23T22:59:03.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18362026-06-23T22:59:03.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18372026-06-23T22:59:04.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18382026-06-23T22:59:04.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18392026-06-23T22:59:04.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
18402026-06-23T22:59:04.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
18412026-06-23T22:59:04.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18422026-06-23T22:59:04.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18432026-06-23T22:59:04.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18442026-06-23T22:59:04.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18452026-06-23T22:59:04.665ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
18462026-06-23T22:59:04.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18472026-06-23T22:59:04.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18482026-06-23T22:59:04.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
18492026-06-23T22:59:04.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
18502026-06-23T22:59:04.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18512026-06-23T22:59:04.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
18522026-06-23T22:59:04.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 371
18532026-06-23T22:59:04.890ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 371
18542026-06-23T22:59:04.890ZDEBGoximeter (clickhouse-client): unrolling 371 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
18552026-06-23T22:59:04.902ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
18562026-06-23T22:59:04.912ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 280 table_name = fields_i16
18572026-06-23T22:59:04.914ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 823 table_name = fields_string
18582026-06-23T22:59:04.916ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 151 table_name = fields_u16
18592026-06-23T22:59:04.917ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 145 table_name = fields_u32
18602026-06-23T22:59:04.918ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 144 table_name = fields_u8
18612026-06-23T22:59:04.920ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 519 table_name = fields_uuid
18622026-06-23T22:59:04.921ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 4 table_name = measurements_bool
18632026-06-23T22:59:04.922ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 265 table_name = measurements_cumulativeu64
18642026-06-23T22:59:04.924ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1 table_name = measurements_f64
18652026-06-23T22:59:04.926ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
18662026-06-23T22:59:04.930ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 90 table_name = measurements_u64
18672026-06-23T22:59:04.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
18682026-06-23T22:59:05.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18692026-06-23T22:59:05.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18702026-06-23T22:59:05.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18712026-06-23T22:59:05.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18722026-06-23T22:59:05.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18732026-06-23T22:59:05.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18742026-06-23T22:59:05.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18752026-06-23T22:59:05.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18762026-06-23T22:59:05.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18772026-06-23T22:59:06.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18782026-06-23T22:59:06.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18792026-06-23T22:59:06.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18802026-06-23T22:59:06.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18812026-06-23T22:59:06.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18822026-06-23T22:59:06.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18832026-06-23T22:59:06.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18842026-06-23T22:59:06.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18852026-06-23T22:59:06.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18862026-06-23T22:59:07.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18872026-06-23T22:59:07.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18882026-06-23T22:59:07.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18892026-06-23T22:59:07.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18902026-06-23T22:59:07.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18912026-06-23T22:59:07.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18922026-06-23T22:59:07.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18932026-06-23T22:59:07.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18942026-06-23T22:59:07.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
18952026-06-23T22:59:08.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18962026-06-23T22:59:08.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
18972026-06-23T22:59:08.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18982026-06-23T22:59:08.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
18992026-06-23T22:59:08.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
19002026-06-23T22:59:08.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
19012026-06-23T22:59:08.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
19022026-06-23T22:59:08.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
19032026-06-23T22:59:08.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
19042026-06-23T22:59:09.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
19052026-06-23T22:59:09.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
19062026-06-23T22:59:09.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
19072026-06-23T22:59:09.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
19082026-06-23T22:59:09.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
19092026-06-23T22:59:09.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
19102026-06-23T22:59:09.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
19112026-06-23T22:59:09.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
19122026-06-23T22:59:09.658ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
19132026-06-23T22:59:09.665ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
19142026-06-23T22:59:09.665ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
19152026-06-23T22:59:09.665ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
19162026-06-23T22:59:09.665ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
19172026-06-23T22:59:09.666ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
19182026-06-23T22:59:09.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
19192026-06-23T22:59:09.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
19202026-06-23T22:59:09.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
19212026-06-23T22:59:09.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
19222026-06-23T22:59:09.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 251
19232026-06-23T22:59:09.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 251
19242026-06-23T22:59:09.891ZDEBGoximeter (clickhouse-client): unrolling 251 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
19252026-06-23T22:59:09.899ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
19262026-06-23T22:59:09.905ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 142 table_name = fields_string
19272026-06-23T22:59:09.907ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = fields_u16
19282026-06-23T22:59:09.908ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 119 table_name = fields_uuid
19292026-06-23T22:59:09.910ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 160 table_name = measurements_cumulativeu64
19302026-06-23T22:59:09.912ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = measurements_histogramu64
19312026-06-23T22:59:09.913ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 60 table_name = measurements_u64
19322026-06-23T22:59:09.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
19332026-06-23T22:59:10.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
19342026-06-23T22:59:10.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
19352026-06-23T22:59:10.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
19362026-06-23T22:59:10.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
19372026-06-23T22:59:10.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
19382026-06-23T22:59:10.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
19392026-06-23T22:59:10.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
19402026-06-23T22:59:10.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
19412026-06-23T22:59:10.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
19422026-06-23T22:59:11.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
19432026-06-23T22:59:11.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
19442026-06-23T22:59:11.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
19452026-06-23T22:59:11.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
19462026-06-23T22:59:11.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
19472026-06-23T22:59:11.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
19482026-06-23T22:59:11.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
19492026-06-23T22:59:11.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
19502026-06-23T22:59:11.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
19512026-06-23T22:59:12.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
19522026-06-23T22:59:12.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
19532026-06-23T22:59:12.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
19542026-06-23T22:59:12.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
19552026-06-23T22:59:12.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
19562026-06-23T22:59:12.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
19572026-06-23T22:59:12.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
19582026-06-23T22:59:12.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
19592026-06-23T22:59:12.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
19602026-06-23T22:59:13.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
19612026-06-23T22:59:13.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
19622026-06-23T22:59:13.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
19632026-06-23T22:59:13.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
19642026-06-23T22:59:13.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
19652026-06-23T22:59:13.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
19662026-06-23T22:59:13.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
19672026-06-23T22:59:13.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
19682026-06-23T22:59:13.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
19692026-06-23T22:59:14.646ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
19702026-06-23T22:59:14.646ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending
19712026-06-23T22:59:14.649ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "1edcc8c2-fb22-4a42-b26e-130c81eec93d", "content-length": "1412", "date": "Tue, 23 Jun 2026 22:59:14 GMT"} })
19722026-06-23T22:59:14.649ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D
19732026-06-23T22:59:14.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
19742026-06-23T22:59:14.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
19752026-06-23T22:59:14.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
19762026-06-23T22:59:14.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
19772026-06-23T22:59:14.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
19782026-06-23T22:59:14.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
19792026-06-23T22:59:14.655ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfd988b4-0d1d-449c-a33b-3e5d8ee8cbc0", "content-length": "29", "date": "Tue, 23 Jun 2026 22:59:14 GMT"} })
19802026-06-23T22:59:14.655ZDEBGoximeter (oximeter-agent): received request to register existing metric producer, updating collection information address = [fd00:1122:3344:101::2]:39040 collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d interval = 30s producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df
19812026-06-23T22:59:14.655ZDEBGoximeter (collection-task-handle): notified collection task of new producer endpoint collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
19822026-06-23T22:59:14.655ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 9 n_pruned_tasks = 0
19832026-06-23T22:59:14.655ZDEBGoximeter (collection-task): collection task received request to update its producer information address = [fd00:1122:3344:101::2]:39040 collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d interval = 30s producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
19842026-06-23T22:59:14.656ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
19852026-06-23T22:59:14.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
19862026-06-23T22:59:14.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
19872026-06-23T22:59:14.658ZDEBGoximeter (collection-task): received producer info update with an outstanding collection running, cancelling it and recreating with the new info collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d new_info = ProducerEndpoint { id: 46e88eb5-80e1-48b2-a954-eec40fbcb9df, kind: Service, address: [fd00:1122:3344:101::2]:39040, interval: 30s } producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
19882026-06-23T22:59:14.658ZDEBGoximeter (collection-task): collecting from producer address = [fd00:1122:3344:101::2]:39040 collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
19892026-06-23T22:59:14.660ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
19902026-06-23T22:59:14.660ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
19912026-06-23T22:59:14.668ZDEBGoximeter (collection-task): collected results from producer address = [fd00:1122:3344:101::2]:39040 collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 180 producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
19922026-06-23T22:59:14.668ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
19932026-06-23T22:59:14.668ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 0 producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
19942026-06-23T22:59:14.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
19952026-06-23T22:59:14.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
19962026-06-23T22:59:14.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
19972026-06-23T22:59:14.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
19982026-06-23T22:59:14.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
19992026-06-23T22:59:14.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
20002026-06-23T22:59:14.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 413
20012026-06-23T22:59:14.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 413
20022026-06-23T22:59:14.891ZDEBGoximeter (clickhouse-client): unrolling 413 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
20032026-06-23T22:59:14.904ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
20042026-06-23T22:59:14.912ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 24 table_name = fields_i16
20052026-06-23T22:59:14.914ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 4 table_name = fields_ipaddr
20062026-06-23T22:59:14.915ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 224 table_name = fields_string
20072026-06-23T22:59:14.917ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 27 table_name = fields_u16
20082026-06-23T22:59:14.918ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 24 table_name = fields_u32
20092026-06-23T22:59:14.919ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 12 table_name = fields_u8
20102026-06-23T22:59:14.921ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 139 table_name = fields_uuid
20112026-06-23T22:59:14.922ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 342 table_name = measurements_cumulativeu64
20122026-06-23T22:59:14.924ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
20132026-06-23T22:59:14.926ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 60 table_name = measurements_u64
20142026-06-23T22:59:14.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
20152026-06-23T22:59:15.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
20162026-06-23T22:59:15.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
20172026-06-23T22:59:15.656ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
20182026-06-23T22:59:15.656ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
20192026-06-23T22:59:15.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
20202026-06-23T22:59:15.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
20212026-06-23T22:59:15.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
20222026-06-23T22:59:15.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
20232026-06-23T22:59:15.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
20242026-06-23T22:59:16.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
20252026-06-23T22:59:16.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
20262026-06-23T22:59:16.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
20272026-06-23T22:59:16.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
20282026-06-23T22:59:16.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
20292026-06-23T22:59:16.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
20302026-06-23T22:59:16.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
20312026-06-23T22:59:16.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
20322026-06-23T22:59:16.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
20332026-06-23T22:59:17.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
20342026-06-23T22:59:17.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
20352026-06-23T22:59:17.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
20362026-06-23T22:59:17.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
20372026-06-23T22:59:17.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
20382026-06-23T22:59:17.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
20392026-06-23T22:59:17.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
20402026-06-23T22:59:17.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
20412026-06-23T22:59:17.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
20422026-06-23T22:59:18.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
20432026-06-23T22:59:18.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
20442026-06-23T22:59:18.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
20452026-06-23T22:59:18.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
20462026-06-23T22:59:18.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
20472026-06-23T22:59:18.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
20482026-06-23T22:59:18.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
20492026-06-23T22:59:18.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
20502026-06-23T22:59:18.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
20512026-06-23T22:59:19.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
20522026-06-23T22:59:19.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
20532026-06-23T22:59:19.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
20542026-06-23T22:59:19.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
20552026-06-23T22:59:19.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
20562026-06-23T22:59:19.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
20572026-06-23T22:59:19.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
20582026-06-23T22:59:19.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
20592026-06-23T22:59:19.658ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
20602026-06-23T22:59:19.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
20612026-06-23T22:59:19.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
20622026-06-23T22:59:19.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
20632026-06-23T22:59:19.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
20642026-06-23T22:59:19.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
20652026-06-23T22:59:19.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
20662026-06-23T22:59:19.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
20672026-06-23T22:59:19.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
20682026-06-23T22:59:19.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
20692026-06-23T22:59:19.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 251
20702026-06-23T22:59:19.892ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 251
20712026-06-23T22:59:19.892ZDEBGoximeter (clickhouse-client): unrolling 251 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
20722026-06-23T22:59:19.899ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
20732026-06-23T22:59:19.907ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 142 table_name = fields_string
20742026-06-23T22:59:19.908ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = fields_u16
20752026-06-23T22:59:19.909ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 119 table_name = fields_uuid
20762026-06-23T22:59:19.910ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 160 table_name = measurements_cumulativeu64
20772026-06-23T22:59:19.912ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = measurements_histogramu64
20782026-06-23T22:59:19.914ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 60 table_name = measurements_u64
20792026-06-23T22:59:19.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
20802026-06-23T22:59:20.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
20812026-06-23T22:59:20.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
20822026-06-23T22:59:20.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
20832026-06-23T22:59:20.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
20842026-06-23T22:59:20.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
20852026-06-23T22:59:20.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
20862026-06-23T22:59:20.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
20872026-06-23T22:59:20.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
20882026-06-23T22:59:20.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
20892026-06-23T22:59:21.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
20902026-06-23T22:59:21.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
20912026-06-23T22:59:21.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
20922026-06-23T22:59:21.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
20932026-06-23T22:59:21.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
20942026-06-23T22:59:21.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
20952026-06-23T22:59:21.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
20962026-06-23T22:59:21.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
20972026-06-23T22:59:21.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
20982026-06-23T22:59:22.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
20992026-06-23T22:59:22.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21002026-06-23T22:59:22.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21012026-06-23T22:59:22.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21022026-06-23T22:59:22.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21032026-06-23T22:59:22.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21042026-06-23T22:59:22.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
21052026-06-23T22:59:22.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
21062026-06-23T22:59:22.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
21072026-06-23T22:59:23.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21082026-06-23T22:59:23.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21092026-06-23T22:59:23.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21102026-06-23T22:59:23.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21112026-06-23T22:59:23.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21122026-06-23T22:59:23.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21132026-06-23T22:59:23.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
21142026-06-23T22:59:23.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
21152026-06-23T22:59:23.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
21162026-06-23T22:59:24.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21172026-06-23T22:59:24.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21182026-06-23T22:59:24.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21192026-06-23T22:59:24.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21202026-06-23T22:59:24.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21212026-06-23T22:59:24.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21222026-06-23T22:59:24.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
21232026-06-23T22:59:24.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
21242026-06-23T22:59:24.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
21252026-06-23T22:59:24.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
21262026-06-23T22:59:24.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
21272026-06-23T22:59:24.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
21282026-06-23T22:59:24.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 231
21292026-06-23T22:59:24.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 231
21302026-06-23T22:59:24.891ZDEBGoximeter (clickhouse-client): unrolling 231 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
21312026-06-23T22:59:24.899ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
21322026-06-23T22:59:24.905ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 102 table_name = fields_string
21332026-06-23T22:59:24.906ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = fields_u16
21342026-06-23T22:59:24.908ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 99 table_name = fields_uuid
21352026-06-23T22:59:24.909ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 160 table_name = measurements_cumulativeu64
21362026-06-23T22:59:24.911ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
21372026-06-23T22:59:24.912ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 60 table_name = measurements_u64
21382026-06-23T22:59:24.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
21392026-06-23T22:59:25.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21402026-06-23T22:59:25.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21412026-06-23T22:59:25.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21422026-06-23T22:59:25.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21432026-06-23T22:59:25.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21442026-06-23T22:59:25.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21452026-06-23T22:59:25.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
21462026-06-23T22:59:25.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
21472026-06-23T22:59:25.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
21482026-06-23T22:59:26.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21492026-06-23T22:59:26.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21502026-06-23T22:59:26.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21512026-06-23T22:59:26.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21522026-06-23T22:59:26.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21532026-06-23T22:59:26.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21542026-06-23T22:59:26.680ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
21552026-06-23T22:59:26.680ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
21562026-06-23T22:59:26.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
21572026-06-23T22:59:27.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21582026-06-23T22:59:27.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21592026-06-23T22:59:27.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21602026-06-23T22:59:27.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21612026-06-23T22:59:27.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21622026-06-23T22:59:27.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21632026-06-23T22:59:27.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
21642026-06-23T22:59:27.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
21652026-06-23T22:59:27.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
21662026-06-23T22:59:28.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21672026-06-23T22:59:28.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21682026-06-23T22:59:28.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21692026-06-23T22:59:28.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21702026-06-23T22:59:28.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21712026-06-23T22:59:28.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21722026-06-23T22:59:28.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
21732026-06-23T22:59:28.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
21742026-06-23T22:59:28.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
21752026-06-23T22:59:29.646ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
21762026-06-23T22:59:29.646ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending
21772026-06-23T22:59:29.651ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "024f3d87-93bc-45a1-89d4-fb11fe49ac23", "content-length": "1412", "date": "Tue, 23 Jun 2026 22:59:29 GMT"} })
21782026-06-23T22:59:29.651ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D
21792026-06-23T22:59:29.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21802026-06-23T22:59:29.654ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21812026-06-23T22:59:29.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21822026-06-23T22:59:29.654ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "43b26a61-a243-4f43-a644-8098b8b6f8c1", "content-length": "29", "date": "Tue, 23 Jun 2026 22:59:29 GMT"} })
21832026-06-23T22:59:29.654ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 9 n_pruned_tasks = 0
21842026-06-23T22:59:29.655ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
21852026-06-23T22:59:29.655ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21862026-06-23T22:59:29.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
21872026-06-23T22:59:29.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21882026-06-23T22:59:29.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
21892026-06-23T22:59:29.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21902026-06-23T22:59:29.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
21912026-06-23T22:59:29.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
21922026-06-23T22:59:29.659ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
21932026-06-23T22:59:29.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
21942026-06-23T22:59:29.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
21952026-06-23T22:59:29.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
21962026-06-23T22:59:29.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
21972026-06-23T22:59:29.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
21982026-06-23T22:59:29.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
21992026-06-23T22:59:29.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
22002026-06-23T22:59:29.668ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
22012026-06-23T22:59:29.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22022026-06-23T22:59:29.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22032026-06-23T22:59:29.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22042026-06-23T22:59:29.736ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 1692 producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
22052026-06-23T22:59:29.740ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 1946
22062026-06-23T22:59:29.740ZDEBGoximeter (clickhouse-client): unrolling 1946 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
22072026-06-23T22:59:29.740ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 1946
22082026-06-23T22:59:29.795ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
22092026-06-23T22:59:29.812ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 6 table_name = fields_ipaddr
22102026-06-23T22:59:29.814ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 2488 table_name = fields_string
22112026-06-23T22:59:29.816ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 46 table_name = fields_u16
22122026-06-23T22:59:29.818ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 801 table_name = fields_u32
22132026-06-23T22:59:29.820ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1349 table_name = fields_uuid
22142026-06-23T22:59:29.822ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1846 table_name = measurements_cumulativeu64
22152026-06-23T22:59:29.824ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 40 table_name = measurements_histogramu64
22162026-06-23T22:59:29.826ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 60 table_name = measurements_u64
22172026-06-23T22:59:29.841ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
22182026-06-23T22:59:29.891ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
22192026-06-23T22:59:29.891ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
22202026-06-23T22:59:30.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
22212026-06-23T22:59:30.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
22222026-06-23T22:59:30.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
22232026-06-23T22:59:30.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
22242026-06-23T22:59:30.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
22252026-06-23T22:59:30.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
22262026-06-23T22:59:30.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22272026-06-23T22:59:30.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22282026-06-23T22:59:30.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22292026-06-23T22:59:31.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
22302026-06-23T22:59:31.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
22312026-06-23T22:59:31.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
22322026-06-23T22:59:31.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
22332026-06-23T22:59:31.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
22342026-06-23T22:59:31.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
22352026-06-23T22:59:31.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22362026-06-23T22:59:31.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22372026-06-23T22:59:31.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22382026-06-23T22:59:32.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
22392026-06-23T22:59:32.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
22402026-06-23T22:59:32.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
22412026-06-23T22:59:32.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
22422026-06-23T22:59:32.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
22432026-06-23T22:59:32.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
22442026-06-23T22:59:32.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22452026-06-23T22:59:32.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22462026-06-23T22:59:32.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22472026-06-23T22:59:33.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
22482026-06-23T22:59:33.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
22492026-06-23T22:59:33.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
22502026-06-23T22:59:33.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
22512026-06-23T22:59:33.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
22522026-06-23T22:59:33.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
22532026-06-23T22:59:33.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22542026-06-23T22:59:33.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22552026-06-23T22:59:33.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22562026-06-23T22:59:34.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
22572026-06-23T22:59:34.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
22582026-06-23T22:59:34.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
22592026-06-23T22:59:34.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
22602026-06-23T22:59:34.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
22612026-06-23T22:59:34.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
22622026-06-23T22:59:34.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22632026-06-23T22:59:34.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
22642026-06-23T22:59:34.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
22652026-06-23T22:59:34.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22662026-06-23T22:59:34.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22672026-06-23T22:59:34.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
22682026-06-23T22:59:34.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 231
22692026-06-23T22:59:34.891ZDEBGoximeter (clickhouse-client): unrolling 231 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
22702026-06-23T22:59:34.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 231
22712026-06-23T22:59:34.898ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
22722026-06-23T22:59:34.904ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 102 table_name = fields_string
22732026-06-23T22:59:34.906ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = fields_u16
22742026-06-23T22:59:34.908ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 99 table_name = fields_uuid
22752026-06-23T22:59:34.909ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 160 table_name = measurements_cumulativeu64
22762026-06-23T22:59:34.911ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
22772026-06-23T22:59:34.912ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 60 table_name = measurements_u64
22782026-06-23T22:59:34.991ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
22792026-06-23T22:59:35.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
22802026-06-23T22:59:35.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
22812026-06-23T22:59:35.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
22822026-06-23T22:59:35.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
22832026-06-23T22:59:35.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
22842026-06-23T22:59:35.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
22852026-06-23T22:59:35.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22862026-06-23T22:59:35.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22872026-06-23T22:59:35.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22882026-06-23T22:59:36.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
22892026-06-23T22:59:36.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
22902026-06-23T22:59:36.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
22912026-06-23T22:59:36.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
22922026-06-23T22:59:36.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
22932026-06-23T22:59:36.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
22942026-06-23T22:59:36.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22952026-06-23T22:59:36.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22962026-06-23T22:59:36.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
22972026-06-23T22:59:37.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
22982026-06-23T22:59:37.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
22992026-06-23T22:59:37.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23002026-06-23T22:59:37.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23012026-06-23T22:59:37.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
23022026-06-23T22:59:37.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23032026-06-23T22:59:37.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
23042026-06-23T22:59:37.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
23052026-06-23T22:59:37.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
23062026-06-23T22:59:38.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23072026-06-23T22:59:38.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23082026-06-23T22:59:38.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
23092026-06-23T22:59:38.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
23102026-06-23T22:59:38.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23112026-06-23T22:59:38.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
23122026-06-23T22:59:38.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
23132026-06-23T22:59:38.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
23142026-06-23T22:59:38.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
23152026-06-23T22:59:39.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
23162026-06-23T22:59:39.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
23172026-06-23T22:59:39.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23182026-06-23T22:59:39.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23192026-06-23T22:59:39.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
23202026-06-23T22:59:39.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
23212026-06-23T22:59:39.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
23222026-06-23T22:59:39.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23232026-06-23T22:59:39.658ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
23242026-06-23T22:59:39.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
23252026-06-23T22:59:39.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
23262026-06-23T22:59:39.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
23272026-06-23T22:59:39.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
23282026-06-23T22:59:39.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
23292026-06-23T22:59:39.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
23302026-06-23T22:59:39.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
23312026-06-23T22:59:39.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
23322026-06-23T22:59:39.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
23332026-06-23T22:59:39.892ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 251
23342026-06-23T22:59:39.892ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 251
23352026-06-23T22:59:39.892ZDEBGoximeter (clickhouse-client): unrolling 251 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
23362026-06-23T22:59:39.900ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
23372026-06-23T22:59:39.906ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 142 table_name = fields_string
23382026-06-23T22:59:39.908ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = fields_u16
23392026-06-23T22:59:39.909ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 119 table_name = fields_uuid
23402026-06-23T22:59:39.910ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 160 table_name = measurements_cumulativeu64
23412026-06-23T22:59:39.912ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = measurements_histogramu64
23422026-06-23T22:59:39.914ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 60 table_name = measurements_u64
23432026-06-23T22:59:39.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
23442026-06-23T22:59:40.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
23452026-06-23T22:59:40.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
23462026-06-23T22:59:40.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23472026-06-23T22:59:40.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23482026-06-23T22:59:40.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
23492026-06-23T22:59:40.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23502026-06-23T22:59:40.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
23512026-06-23T22:59:40.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
23522026-06-23T22:59:40.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
23532026-06-23T22:59:41.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
23542026-06-23T22:59:41.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
23552026-06-23T22:59:41.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23562026-06-23T22:59:41.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23572026-06-23T22:59:41.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23582026-06-23T22:59:41.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
23592026-06-23T22:59:41.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
23602026-06-23T22:59:41.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
23612026-06-23T22:59:41.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
23622026-06-23T22:59:42.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
23632026-06-23T22:59:42.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
23642026-06-23T22:59:42.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23652026-06-23T22:59:42.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23662026-06-23T22:59:42.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23672026-06-23T22:59:42.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
23682026-06-23T22:59:42.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
23692026-06-23T22:59:42.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
23702026-06-23T22:59:42.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
23712026-06-23T22:59:43.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
23722026-06-23T22:59:43.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
23732026-06-23T22:59:43.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23742026-06-23T22:59:43.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23752026-06-23T22:59:43.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
23762026-06-23T22:59:43.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23772026-06-23T22:59:43.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
23782026-06-23T22:59:43.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
23792026-06-23T22:59:43.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
23802026-06-23T22:59:44.646ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
23812026-06-23T22:59:44.646ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending
23822026-06-23T22:59:44.650ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "d67bafaf-b220-4c62-a6d6-c283f2f42239", "content-length": "1412", "date": "Tue, 23 Jun 2026 22:59:44 GMT"} })
23832026-06-23T22:59:44.650ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D
23842026-06-23T22:59:44.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
23852026-06-23T22:59:44.653ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
23862026-06-23T22:59:44.653ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
23872026-06-23T22:59:44.654ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "1da54961-8975-492b-afcc-3d4a01bbb62a", "content-length": "29", "date": "Tue, 23 Jun 2026 22:59:44 GMT"} })
23882026-06-23T22:59:44.654ZDEBGoximeter (oximeter-agent): received request to register existing metric producer, updating collection information address = [fd00:1122:3344:101::2]:35012 collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df
23892026-06-23T22:59:44.654ZDEBGoximeter (collection-task-handle): notified collection task of new producer endpoint collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
23902026-06-23T22:59:44.654ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 9 n_pruned_tasks = 0
23912026-06-23T22:59:44.654ZDEBGoximeter (collection-task): collection task received request to update its producer information address = [fd00:1122:3344:101::2]:35012 collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
23922026-06-23T22:59:44.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
23932026-06-23T22:59:44.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
23942026-06-23T22:59:44.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23952026-06-23T22:59:44.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23962026-06-23T22:59:44.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
23972026-06-23T22:59:44.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
23982026-06-23T22:59:44.666ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
23992026-06-23T22:59:44.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
24002026-06-23T22:59:44.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
24012026-06-23T22:59:44.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
24022026-06-23T22:59:44.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
24032026-06-23T22:59:44.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
24042026-06-23T22:59:44.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
24052026-06-23T22:59:44.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 372
24062026-06-23T22:59:44.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 372
24072026-06-23T22:59:44.891ZDEBGoximeter (clickhouse-client): unrolling 372 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
24082026-06-23T22:59:44.902ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
24092026-06-23T22:59:44.912ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 280 table_name = fields_i16
24102026-06-23T22:59:44.913ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 2 table_name = fields_ipaddr
24112026-06-23T22:59:44.914ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 824 table_name = fields_string
24122026-06-23T22:59:44.916ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 153 table_name = fields_u16
24132026-06-23T22:59:44.917ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 145 table_name = fields_u32
24142026-06-23T22:59:44.918ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 144 table_name = fields_u8
24152026-06-23T22:59:44.919ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 521 table_name = fields_uuid
24162026-06-23T22:59:44.921ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 4 table_name = measurements_bool
24172026-06-23T22:59:44.922ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 266 table_name = measurements_cumulativeu64
24182026-06-23T22:59:44.923ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1 table_name = measurements_f64
24192026-06-23T22:59:44.925ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
24202026-06-23T22:59:44.926ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 90 table_name = measurements_u64
24212026-06-23T22:59:44.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
24222026-06-23T22:59:45.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
24232026-06-23T22:59:45.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
24242026-06-23T22:59:45.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
24252026-06-23T22:59:45.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
24262026-06-23T22:59:45.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
24272026-06-23T22:59:45.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
24282026-06-23T22:59:45.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
24292026-06-23T22:59:45.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
24302026-06-23T22:59:45.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
24312026-06-23T22:59:46.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
24322026-06-23T22:59:46.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
24332026-06-23T22:59:46.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
24342026-06-23T22:59:46.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
24352026-06-23T22:59:46.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
24362026-06-23T22:59:46.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
24372026-06-23T22:59:46.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
24382026-06-23T22:59:46.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
24392026-06-23T22:59:46.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
24402026-06-23T22:59:47.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
24412026-06-23T22:59:47.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
24422026-06-23T22:59:47.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
24432026-06-23T22:59:47.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
24442026-06-23T22:59:47.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
24452026-06-23T22:59:47.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
24462026-06-23T22:59:47.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
24472026-06-23T22:59:47.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
24482026-06-23T22:59:47.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
24492026-06-23T22:59:48.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
24502026-06-23T22:59:48.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
24512026-06-23T22:59:48.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
24522026-06-23T22:59:48.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
24532026-06-23T22:59:48.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
24542026-06-23T22:59:48.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
24552026-06-23T22:59:48.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
24562026-06-23T22:59:48.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
24572026-06-23T22:59:48.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
24582026-06-23T22:59:49.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
24592026-06-23T22:59:49.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
24602026-06-23T22:59:49.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
24612026-06-23T22:59:49.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
24622026-06-23T22:59:49.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
24632026-06-23T22:59:49.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
24642026-06-23T22:59:49.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
24652026-06-23T22:59:49.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
24662026-06-23T22:59:49.658ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
24672026-06-23T22:59:49.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
24682026-06-23T22:59:49.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
24692026-06-23T22:59:49.666ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
24702026-06-23T22:59:49.666ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
24712026-06-23T22:59:49.667ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
24722026-06-23T22:59:49.668ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
24732026-06-23T22:59:49.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
24742026-06-23T22:59:49.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
24752026-06-23T22:59:49.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
24762026-06-23T22:59:49.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 251
24772026-06-23T22:59:49.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 251
24782026-06-23T22:59:49.891ZDEBGoximeter (clickhouse-client): unrolling 251 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
24792026-06-23T22:59:49.899ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
24802026-06-23T22:59:49.906ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 142 table_name = fields_string
24812026-06-23T22:59:49.907ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = fields_u16
24822026-06-23T22:59:49.908ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 119 table_name = fields_uuid
24832026-06-23T22:59:49.910ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 160 table_name = measurements_cumulativeu64
24842026-06-23T22:59:49.912ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 31 table_name = measurements_histogramu64
24852026-06-23T22:59:49.913ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 60 table_name = measurements_u64
24862026-06-23T22:59:49.992ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
24872026-06-23T22:59:50.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
24882026-06-23T22:59:50.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
24892026-06-23T22:59:50.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
24902026-06-23T22:59:50.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
24912026-06-23T22:59:50.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
24922026-06-23T22:59:50.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
24932026-06-23T22:59:50.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
24942026-06-23T22:59:50.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
24952026-06-23T22:59:50.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
24962026-06-23T22:59:51.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
24972026-06-23T22:59:51.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
24982026-06-23T22:59:51.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
24992026-06-23T22:59:51.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25002026-06-23T22:59:51.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25012026-06-23T22:59:51.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25022026-06-23T22:59:51.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25032026-06-23T22:59:51.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25042026-06-23T22:59:51.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25052026-06-23T22:59:52.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25062026-06-23T22:59:52.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25072026-06-23T22:59:52.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25082026-06-23T22:59:52.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25092026-06-23T22:59:52.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25102026-06-23T22:59:52.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25112026-06-23T22:59:52.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25122026-06-23T22:59:52.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25132026-06-23T22:59:52.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25142026-06-23T22:59:53.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25152026-06-23T22:59:53.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25162026-06-23T22:59:53.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25172026-06-23T22:59:53.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25182026-06-23T22:59:53.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25192026-06-23T22:59:53.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25202026-06-23T22:59:53.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25212026-06-23T22:59:53.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25222026-06-23T22:59:53.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25232026-06-23T22:59:54.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25242026-06-23T22:59:54.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25252026-06-23T22:59:54.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25262026-06-23T22:59:54.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
25272026-06-23T22:59:54.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
25282026-06-23T22:59:54.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25292026-06-23T22:59:54.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25302026-06-23T22:59:54.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25312026-06-23T22:59:54.666ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = 46e88eb5-80e1-48b2-a954-eec40fbcb9df producer_ip = fd00:1122:3344:101::2 producer_port = 39040
25322026-06-23T22:59:54.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25332026-06-23T22:59:54.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25342026-06-23T22:59:54.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
25352026-06-23T22:59:54.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
25362026-06-23T22:59:54.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25372026-06-23T22:59:54.681ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = ae54ec7e-3930-48c8-8771-116385de407c producer_ip = fd00:1122:3344:101::2 producer_port = 64621
25382026-06-23T22:59:54.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 371
25392026-06-23T22:59:54.891ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 371
25402026-06-23T22:59:54.891ZDEBGoximeter (clickhouse-client): unrolling 371 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
25412026-06-23T22:59:54.903ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
25422026-06-23T22:59:54.912ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 280 table_name = fields_i16
25432026-06-23T22:59:54.914ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 823 table_name = fields_string
25442026-06-23T22:59:54.915ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 151 table_name = fields_u16
25452026-06-23T22:59:54.917ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 145 table_name = fields_u32
25462026-06-23T22:59:54.918ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 144 table_name = fields_u8
25472026-06-23T22:59:54.920ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 519 table_name = fields_uuid
25482026-06-23T22:59:54.921ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 4 table_name = measurements_bool
25492026-06-23T22:59:54.922ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 265 table_name = measurements_cumulativeu64
25502026-06-23T22:59:54.924ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1 table_name = measurements_f64
25512026-06-23T22:59:54.926ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 11 table_name = measurements_histogramu64
25522026-06-23T22:59:54.927ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 90 table_name = measurements_u64
25532026-06-23T22:59:54.991ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
25542026-06-23T22:59:55.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25552026-06-23T22:59:55.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25562026-06-23T22:59:55.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25572026-06-23T22:59:55.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25582026-06-23T22:59:55.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25592026-06-23T22:59:55.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25602026-06-23T22:59:55.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25612026-06-23T22:59:55.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25622026-06-23T22:59:55.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25632026-06-23T22:59:56.653ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25642026-06-23T22:59:56.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25652026-06-23T22:59:56.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25662026-06-23T22:59:56.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25672026-06-23T22:59:56.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25682026-06-23T22:59:56.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25692026-06-23T22:59:56.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25702026-06-23T22:59:56.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25712026-06-23T22:59:56.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25722026-06-23T22:59:57.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25732026-06-23T22:59:57.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25742026-06-23T22:59:57.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25752026-06-23T22:59:57.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25762026-06-23T22:59:57.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25772026-06-23T22:59:57.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25782026-06-23T22:59:57.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25792026-06-23T22:59:57.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25802026-06-23T22:59:57.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25812026-06-23T22:59:58.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25822026-06-23T22:59:58.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25832026-06-23T22:59:58.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25842026-06-23T22:59:58.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25852026-06-23T22:59:58.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25862026-06-23T22:59:58.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25872026-06-23T22:59:58.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25882026-06-23T22:59:58.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25892026-06-23T22:59:58.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
25902026-06-23T22:59:59.646ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
25912026-06-23T22:59:59.646ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending
25922026-06-23T22:59:59.651ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfda30c4-2bc0-44aa-ac0a-a0188de329f1", "content-length": "1412", "date": "Tue, 23 Jun 2026 22:59:59 GMT"} })
25932026-06-23T22:59:59.651ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D
25942026-06-23T22:59:59.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25952026-06-23T22:59:59.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
25962026-06-23T22:59:59.654ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26fdb619-6753-40d1-aec4-c7353c5b5541/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkYmIxMDMzYS0xMmE0LTQ5ZjEtOGNlNS04YmE3NTA2MmYzNzAifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "9cb797be-8827-494f-94b4-32bcfab8f71a", "content-length": "29", "date": "Tue, 23 Jun 2026 22:59:59 GMT"} })
25972026-06-23T22:59:59.654ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 9 n_pruned_tasks = 0
25982026-06-23T22:59:59.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
25992026-06-23T22:59:59.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
26002026-06-23T22:59:59.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
26012026-06-23T22:59:59.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
26022026-06-23T22:59:59.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
26032026-06-23T22:59:59.656ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
26042026-06-23T22:59:59.658ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 39814b64-81dd-4128-9229-e941c9d44086 producer_ip = fd00:1122:3344:101::a producer_port = 33407
26052026-06-23T22:59:59.666ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
26062026-06-23T22:59:59.666ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
26072026-06-23T22:59:59.666ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
26082026-06-23T22:59:59.667ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
26092026-06-23T22:59:59.667ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
26102026-06-23T22:59:59.667ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
26112026-06-23T22:59:59.667ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
26122026-06-23T22:59:59.667ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
26132026-06-23T22:59:59.667ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
26142026-06-23T22:59:59.668ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = 8e925fb2-2fba-4ac6-bc5b-a7b0798c4ee2 producer_ip = fd00:1122:3344:101::b producer_port = 50068
26152026-06-23T22:59:59.668ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 5 producer_id = dbb1033a-12a4-49f1-8ce5-8ba75062f370 producer_ip = fd00:1122:3344:101::c producer_port = 52684
26162026-06-23T22:59:59.678ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
26172026-06-23T22:59:59.678ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
26182026-06-23T22:59:59.679ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
26192026-06-23T22:59:59.742ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 1844 producer_id = 462f5276-d6e3-49e7-9d58-26b144804069 producer_ip = fd00:1122:3344:101::1 producer_port = 46180
26202026-06-23T22:59:59.747ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 2098
26212026-06-23T22:59:59.747ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_samples = 2098
26222026-06-23T22:59:59.747ZDEBGoximeter (clickhouse-client): unrolling 2098 total samples collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
26232026-06-23T22:59:59.806ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4
26242026-06-23T22:59:59.826ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 6 table_name = fields_ipaddr
26252026-06-23T22:59:59.829ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 3348 table_name = fields_string
26262026-06-23T22:59:59.830ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 46 table_name = fields_u16
26272026-06-23T22:59:59.832ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 953 table_name = fields_u32
26282026-06-23T22:59:59.834ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1931 table_name = fields_uuid
26292026-06-23T22:59:59.836ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 1846 table_name = measurements_cumulativeu64
26302026-06-23T22:59:59.837ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 40 table_name = measurements_histogramu64
26312026-06-23T22:59:59.839ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d id = 4151f736-dc38-48c1-a3bb-03c88d29abf4 n_rows = 212 table_name = measurements_u64
26322026-06-23T22:59:59.848ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
26332026-06-23T22:59:59.891ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
26342026-06-23T22:59:59.891ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d
26352026-06-23T23:00:00.654ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
26362026-06-23T23:00:00.654ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
26372026-06-23T23:00:00.655ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
26382026-06-23T23:00:00.655ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
26392026-06-23T23:00:00.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = a6699adf-aad1-4e6a-9f1d-ea875087986e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
26402026-06-23T23:00:00.657ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 4b354945-1027-4e82-a419-e886529e4eab producer_ip = fd00:1122:3344:101::2 producer_port = 8001
26412026-06-23T23:00:00.679ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
26422026-06-23T23:00:00.679ZDEBGoximeter (collection-task): collecting from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677
26432026-06-23T23:00:00.680ZDEBGoximeter (collection-task): collected results from producer collector_id = 26fdb619-6753-40d1-aec4-c7353c5b5541 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 5ec2ef12-fa56-4da1-ac77-d70ec1602961 producer_ip = fd00:1122:3344:101::2 producer_port = 4677