Max level shown:
1 [ Jul 1 19:40:43 Enabled. ]
2 [ Jul 1 19:40:43 Rereading configuration. ]
3 [ Jul 1 19:40:44 Rereading configuration. ]
4 [ Jul 1 19:40:51 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id 7e98d451-495f-44e2-be17-0c1e3ae1019c &"). ]
5 [ Jul 1 19:40:51 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72025-07-01T19:40:51.847ZDEBGoximeter: registered DTrace probes
82025-07-01T19:40:51.851ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:236
92025-07-01T19:40:51.858ZDEBGoximeter: creating ClickHouse client
102025-07-01T19:40:51.933ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
112025-07-01T19:40:54.661ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:896 id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
122025-07-01T19:40:54.661ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
132025-07-01T19:40:54.661ZINFOoximeter (clickhouse-client): reading db version collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:796 id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
142025-07-01T19:40:54.662ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:896 id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
152025-07-01T19:40:54.662ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:801 id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 version = 0
162025-07-01T19:40:54.662ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:806 id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
172025-07-01T19:40:54.662ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
182025-07-01T19:40:54.880ZINFOoximeter (clickhouse-client): inserting current version collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:827 id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 version = 14
192025-07-01T19:40:54.915ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 66d70c25-8dbe-42ec-9a01-d433fe6dccda
202025-07-01T19:40:54.940ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212025-07-01T19:40:54.940ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222025-07-01T19:40:54.940ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232025-07-01T19:40:54.940ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242025-07-01T19:40:54.940ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:328 local_addr = [fd00:1122:3344:101::d]:12223
252025-07-01T19:40:54.940ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262025-07-01T19:40:54.940ZDEBGoximeter: registered USDT probes
272025-07-01T19:40:54.940ZDEBGoximeter: contacting nexus
282025-07-01T19:40:55.095ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
292025-07-01T19:40:55.100ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::c]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
302025-07-01T19:40:55.100ZWARNoximeter: failed to contact nexus, will retry in 215.329929ms error = "Communication Error: error sending request" file = oximeter/collector/src/lib.rs:375
312025-07-01T19:40:55.317ZDEBGoximeter: contacting nexus
322025-07-01T19:40:55.317ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
332025-07-01T19:40:55.317ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
342025-07-01T19:40:55.317ZWARNoximeter: failed to contact nexus, will retry in 450.611926ms error = "Communication Error: error sending request" file = oximeter/collector/src/lib.rs:375
352025-07-01T19:40:55.769ZDEBGoximeter: contacting nexus
362025-07-01T19:40:55.769ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
372025-07-01T19:40:55.769ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::c]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
382025-07-01T19:40:55.769ZWARNoximeter: failed to contact nexus, will retry in 836.454923ms error = "Communication Error: error sending request" file = oximeter/collector/src/lib.rs:375
392025-07-01T19:40:56.607ZDEBGoximeter: contacting nexus
402025-07-01T19:40:56.607ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
412025-07-01T19:40:56.608ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::c]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
422025-07-01T19:40:56.608ZWARNoximeter: failed to contact nexus, will retry in 2.384247046s error = "Communication Error: error sending request" file = oximeter/collector/src/lib.rs:375
432025-07-01T19:40:58.993ZDEBGoximeter: contacting nexus
442025-07-01T19:40:58.993ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
452025-07-01T19:40:59.065ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "cf28c301-e6ff-4604-9e7d-d6a53dc3df5c", "date": "Tue, 01 Jul 2025 19:40:59 GMT"} })
462025-07-01T19:40:59.069ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:393 id = 7e98d451-495f-44e2-be17-0c1e3ae1019c
472025-07-01T19:40:59.069ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:559
482025-07-01T19:40:59.070ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
492025-07-01T19:40:59.075ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending
502025-07-01T19:40:59.108ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fc3f35a-6972-47a6-8347-f05c90a6ecbe", "content-length": "29", "date": "Tue, 01 Jul 2025 19:40:59 GMT"} })
512025-07-01T19:40:59.110ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:637 n_current_tasks = 0 n_pruned_tasks = 0
522025-07-01T19:41:14.070ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
532025-07-01T19:41:14.070ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending
542025-07-01T19:41:14.088ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "2837cbe9-579e-49a4-89ce-af951a895789", "content-length": "574", "date": "Tue, 01 Jul 2025 19:41:14 GMT"} })
552025-07-01T19:41:14.092ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkODM0YzFiMS1iMDRlLTRkZDUtOGU4OC1lYzhhYTBlMjk0YmQifX0%3D
562025-07-01T19:41:14.095ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkODM0YzFiMS1iMDRlLTRkZDUtOGU4OC1lYzhhYTBlMjk0YmQifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6f982c6-4d53-48dc-a296-9899b7988600", "content-length": "29", "date": "Tue, 01 Jul 2025 19:41:14 GMT"} })
572025-07-01T19:41:14.096ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:43787 collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
582025-07-01T19:41:14.098ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:59411 collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
592025-07-01T19:41:14.100ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
602025-07-01T19:41:14.102ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:637 n_current_tasks = 3 n_pruned_tasks = 0
612025-07-01T19:41:15.101ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
622025-07-01T19:41:15.101ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
632025-07-01T19:41:15.148ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
642025-07-01T19:41:16.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
652025-07-01T19:41:16.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
662025-07-01T19:41:16.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
672025-07-01T19:41:17.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
682025-07-01T19:41:17.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
692025-07-01T19:41:17.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
702025-07-01T19:41:18.101ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
712025-07-01T19:41:18.101ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
722025-07-01T19:41:18.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
732025-07-01T19:41:19.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
742025-07-01T19:41:19.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
752025-07-01T19:41:19.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
762025-07-01T19:41:19.919ZDEBGoximeter (results-sink-cluster): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
772025-07-01T19:41:19.919ZDEBGoximeter (results-sink): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
782025-07-01T19:41:19.919ZDEBGoximeter (clickhouse-client): unrolling 70 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
792025-07-01T19:41:19.924ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
802025-07-01T19:41:19.964ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:19.924949476Z } timeseries_name = ddm_router:originated_underlay_prefixes
812025-07-01T19:41:19.968ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
822025-07-01T19:41:19.983ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:19.968646564Z } timeseries_name = ddm_router:originated_tunnel_endpoints
832025-07-01T19:41:19.983ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
842025-07-01T19:41:19.988ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:19.983623249Z } timeseries_name = ddm_session:solicitations_sent
852025-07-01T19:41:19.988ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
862025-07-01T19:41:19.989ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:19.988695172Z } timeseries_name = ddm_session:solicitations_received
872025-07-01T19:41:19.989ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
882025-07-01T19:41:19.990ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:19.989641790Z } timeseries_name = ddm_session:advertisements_sent
892025-07-01T19:41:19.990ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
902025-07-01T19:41:19.991ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:19.990678599Z } timeseries_name = ddm_session:advertisements_received
912025-07-01T19:41:19.991ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
922025-07-01T19:41:19.992ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:19.991627837Z } timeseries_name = ddm_session:peer_expirations
932025-07-01T19:41:19.992ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
942025-07-01T19:41:19.993ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:19.992588575Z } timeseries_name = ddm_session:peer_address_changes
952025-07-01T19:41:19.993ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
962025-07-01T19:41:19.994ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:19.993552063Z } timeseries_name = ddm_session:peer_sessions_established
972025-07-01T19:41:19.994ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
982025-07-01T19:41:19.995ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:19.994515131Z } timeseries_name = ddm_session:updates_sent
992025-07-01T19:41:19.995ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
1002025-07-01T19:41:19.996ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:19.995452984Z } timeseries_name = ddm_session:updates_received
1012025-07-01T19:41:19.996ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
1022025-07-01T19:41:19.997ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:19.996468328Z } timeseries_name = ddm_session:update_send_fail
1032025-07-01T19:41:19.997ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
1042025-07-01T19:41:19.998ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:19.997464446Z } timeseries_name = ddm_session:imported_underlay_prefixes
1052025-07-01T19:41:19.998ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
1062025-07-01T19:41:19.999ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:19.998405434Z } timeseries_name = ddm_session:imported_tunnel_endpoints
1072025-07-01T19:41:20.001ZDEBGoximeter (clickhouse-client): inserting 14 new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
1082025-07-01T19:41:20.015ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 26 table_name = fields_string
1092025-07-01T19:41:20.017ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 28 table_name = fields_uuid
1102025-07-01T19:41:20.019ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
1112025-07-01T19:41:20.026ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 50 table_name = measurements_cumulativeu64
1122025-07-01T19:41:20.028ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 20 table_name = measurements_u64
1132025-07-01T19:41:20.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1142025-07-01T19:41:20.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1152025-07-01T19:41:20.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1162025-07-01T19:41:21.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1172025-07-01T19:41:21.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1182025-07-01T19:41:21.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1192025-07-01T19:41:22.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1202025-07-01T19:41:22.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1212025-07-01T19:41:22.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1222025-07-01T19:41:23.101ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1232025-07-01T19:41:23.101ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1242025-07-01T19:41:23.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1252025-07-01T19:41:24.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
1262025-07-01T19:41:24.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
1272025-07-01T19:41:24.098ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
1282025-07-01T19:41:24.098ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
1292025-07-01T19:41:24.101ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1302025-07-01T19:41:24.101ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1312025-07-01T19:41:24.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1322025-07-01T19:41:24.122ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 25dc216c-284d-4191-af96-58995bf80f21
1332025-07-01T19:41:24.126ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
1342025-07-01T19:41:24.918ZDEBGoximeter (results-sink-cluster): inserting 216 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
1352025-07-01T19:41:24.918ZDEBGoximeter (results-sink): inserting 216 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
1362025-07-01T19:41:24.918ZDEBGoximeter (clickhouse-client): unrolling 216 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
1372025-07-01T19:41:24.921ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
1382025-07-01T19:41:24.972ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:24.921417512Z } timeseries_name = http_service:request_latency_histogram
1392025-07-01T19:41:24.974ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
1402025-07-01T19:41:24.976ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:24.974466518Z } timeseries_name = collection_target:cpus_provisioned
1412025-07-01T19:41:24.976ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
1422025-07-01T19:41:24.977ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:24.976297703Z } timeseries_name = collection_target:ram_provisioned
1432025-07-01T19:41:24.977ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
1442025-07-01T19:41:24.979ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:24.977808916Z } timeseries_name = collection_target:virtual_disk_space_provisioned
1452025-07-01T19:41:24.980ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
1462025-07-01T19:41:24.981ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:24.980048785Z } timeseries_name = switch_data_link:link_enabled
1472025-07-01T19:41:24.988ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
1482025-07-01T19:41:24.990ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:24.988205903Z } timeseries_name = switch_data_link:link_up
1492025-07-01T19:41:24.990ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
1502025-07-01T19:41:24.992ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:24.990825145Z } timeseries_name = switch_table:capacity
1512025-07-01T19:41:24.992ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
1522025-07-01T19:41:24.994ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:24.992582540Z } timeseries_name = switch_table:occupancy
1532025-07-01T19:41:24.994ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
1542025-07-01T19:41:24.995ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:24.994324345Z } timeseries_name = switch_table:inserts
1552025-07-01T19:41:24.995ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
1562025-07-01T19:41:24.997ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:24.995961928Z } timeseries_name = switch_table:deletes
1572025-07-01T19:41:24.997ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
1582025-07-01T19:41:24.998ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:24.997500651Z } timeseries_name = switch_table:updates
1592025-07-01T19:41:24.999ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
1602025-07-01T19:41:25.000ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:24.999088555Z } timeseries_name = switch_table:collisions
1612025-07-01T19:41:25.000ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
1622025-07-01T19:41:25.002ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:25.000660608Z } timeseries_name = switch_table:update_misses
1632025-07-01T19:41:25.002ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
1642025-07-01T19:41:25.003ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:25.002197861Z } timeseries_name = switch_table:delete_misses
1652025-07-01T19:41:25.003ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
1662025-07-01T19:41:25.005ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:25.003687473Z } timeseries_name = switch_table:exhaustion
1672025-07-01T19:41:25.011ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
1682025-07-01T19:41:25.012ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:41:25.011076555Z } timeseries_name = dendrite:sample_collection_duration
1692025-07-01T19:41:25.012ZDEBGoximeter (clickhouse-client): inserting 16 new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
1702025-07-01T19:41:25.018ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 212 table_name = fields_i16
1712025-07-01T19:41:25.019ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
1722025-07-01T19:41:25.019ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 631 table_name = fields_string
1732025-07-01T19:41:25.021ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 128 table_name = fields_u16
1742025-07-01T19:41:25.022ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 113 table_name = fields_u32
1752025-07-01T19:41:25.026ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 112 table_name = fields_u8
1762025-07-01T19:41:25.028ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 378 table_name = fields_uuid
1772025-07-01T19:41:25.029ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 6 table_name = measurements_bool
1782025-07-01T19:41:25.030ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 127 table_name = measurements_cumulativeu64
1792025-07-01T19:41:25.032ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 1 table_name = measurements_f64
1802025-07-01T19:41:25.037ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 22 table_name = measurements_histogramu64
1812025-07-01T19:41:25.038ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 18 table_name = measurements_i64
1822025-07-01T19:41:25.039ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 42 table_name = measurements_u64
1832025-07-01T19:41:25.101ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1842025-07-01T19:41:25.101ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1852025-07-01T19:41:25.102ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1862025-07-01T19:41:26.101ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1872025-07-01T19:41:26.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1882025-07-01T19:41:26.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1892025-07-01T19:41:27.101ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1902025-07-01T19:41:27.101ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1912025-07-01T19:41:27.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1922025-07-01T19:41:28.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1932025-07-01T19:41:28.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1942025-07-01T19:41:28.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1952025-07-01T19:41:29.070ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
1962025-07-01T19:41:29.070ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending
1972025-07-01T19:41:29.101ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1982025-07-01T19:41:29.101ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
1992025-07-01T19:41:29.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2002025-07-01T19:41:29.108ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e26192c-5ce5-4bc6-bea1-acff80cb5ace", "content-length": "574", "date": "Tue, 01 Jul 2025 19:41:29 GMT"} })
2012025-07-01T19:41:29.108ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkODM0YzFiMS1iMDRlLTRkZDUtOGU4OC1lYzhhYTBlMjk0YmQifX0%3D
2022025-07-01T19:41:29.118ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkODM0YzFiMS1iMDRlLTRkZDUtOGU4OC1lYzhhYTBlMjk0YmQifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "db81736b-3722-4ce6-a062-7d9d0dc6749e", "content-length": "29", "date": "Tue, 01 Jul 2025 19:41:29 GMT"} })
2032025-07-01T19:41:29.118ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:637 n_current_tasks = 3 n_pruned_tasks = 0
2042025-07-01T19:41:29.918ZDEBGoximeter (results-sink-cluster): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
2052025-07-01T19:41:29.918ZDEBGoximeter (results-sink): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
2062025-07-01T19:41:29.918ZDEBGoximeter (clickhouse-client): unrolling 70 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
2072025-07-01T19:41:29.923ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 26 table_name = fields_string
2082025-07-01T19:41:29.924ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 28 table_name = fields_uuid
2092025-07-01T19:41:29.926ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 50 table_name = measurements_cumulativeu64
2102025-07-01T19:41:29.927ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 20 table_name = measurements_u64
2112025-07-01T19:41:30.019ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
2122025-07-01T19:41:30.101ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2132025-07-01T19:41:30.101ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2142025-07-01T19:41:30.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2152025-07-01T19:41:31.101ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2162025-07-01T19:41:31.101ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2172025-07-01T19:41:31.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2182025-07-01T19:41:32.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2192025-07-01T19:41:32.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2202025-07-01T19:41:32.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2212025-07-01T19:41:33.101ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2222025-07-01T19:41:33.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2232025-07-01T19:41:33.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2242025-07-01T19:41:34.097ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
2252025-07-01T19:41:34.097ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
2262025-07-01T19:41:34.099ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
2272025-07-01T19:41:34.099ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
2282025-07-01T19:41:34.101ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 25dc216c-284d-4191-af96-58995bf80f21
2292025-07-01T19:41:34.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2302025-07-01T19:41:34.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2312025-07-01T19:41:34.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2322025-07-01T19:41:34.110ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
2332025-07-01T19:41:34.919ZDEBGoximeter (results-sink): inserting 198 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
2342025-07-01T19:41:34.919ZDEBGoximeter (results-sink-cluster): inserting 198 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
2352025-07-01T19:41:34.919ZDEBGoximeter (clickhouse-client): unrolling 198 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
2362025-07-01T19:41:34.930ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 212 table_name = fields_i16
2372025-07-01T19:41:34.932ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 631 table_name = fields_string
2382025-07-01T19:41:34.933ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 128 table_name = fields_u16
2392025-07-01T19:41:34.935ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 113 table_name = fields_u32
2402025-07-01T19:41:34.936ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 112 table_name = fields_u8
2412025-07-01T19:41:34.937ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 368 table_name = fields_uuid
2422025-07-01T19:41:34.939ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 6 table_name = measurements_bool
2432025-07-01T19:41:34.940ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 127 table_name = measurements_cumulativeu64
2442025-07-01T19:41:34.941ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 1 table_name = measurements_f64
2452025-07-01T19:41:34.943ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 22 table_name = measurements_histogramu64
2462025-07-01T19:41:34.944ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 42 table_name = measurements_u64
2472025-07-01T19:41:35.019ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
2482025-07-01T19:41:35.101ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2492025-07-01T19:41:35.101ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2502025-07-01T19:41:35.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2512025-07-01T19:41:36.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2522025-07-01T19:41:36.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2532025-07-01T19:41:36.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2542025-07-01T19:41:37.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2552025-07-01T19:41:37.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2562025-07-01T19:41:37.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2572025-07-01T19:41:38.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2582025-07-01T19:41:38.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2592025-07-01T19:41:38.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2602025-07-01T19:41:39.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2612025-07-01T19:41:39.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2622025-07-01T19:41:39.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2632025-07-01T19:41:39.919ZDEBGoximeter (results-sink): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
2642025-07-01T19:41:39.919ZDEBGoximeter (results-sink-cluster): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
2652025-07-01T19:41:39.919ZDEBGoximeter (clickhouse-client): unrolling 70 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
2662025-07-01T19:41:39.923ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 26 table_name = fields_string
2672025-07-01T19:41:39.925ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 28 table_name = fields_uuid
2682025-07-01T19:41:39.926ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 50 table_name = measurements_cumulativeu64
2692025-07-01T19:41:39.928ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 20 table_name = measurements_u64
2702025-07-01T19:41:40.020ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
2712025-07-01T19:41:40.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2722025-07-01T19:41:40.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2732025-07-01T19:41:40.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2742025-07-01T19:41:41.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2752025-07-01T19:41:41.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2762025-07-01T19:41:41.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2772025-07-01T19:41:42.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2782025-07-01T19:41:42.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2792025-07-01T19:41:42.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2802025-07-01T19:41:43.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2812025-07-01T19:41:43.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2822025-07-01T19:41:43.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2832025-07-01T19:41:44.071ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
2842025-07-01T19:41:44.071ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending
2852025-07-01T19:41:44.075ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "031e3125-efbe-46af-a554-562dba0ca465", "content-length": "574", "date": "Tue, 01 Jul 2025 19:41:43 GMT"} })
2862025-07-01T19:41:44.075ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkODM0YzFiMS1iMDRlLTRkZDUtOGU4OC1lYzhhYTBlMjk0YmQifX0%3D
2872025-07-01T19:41:44.078ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkODM0YzFiMS1iMDRlLTRkZDUtOGU4OC1lYzhhYTBlMjk0YmQifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8e26df6-c032-4aaa-a86d-bad85dda295c", "content-length": "29", "date": "Tue, 01 Jul 2025 19:41:43 GMT"} })
2882025-07-01T19:41:44.078ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:637 n_current_tasks = 3 n_pruned_tasks = 0
2892025-07-01T19:41:44.097ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
2902025-07-01T19:41:44.097ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
2912025-07-01T19:41:44.099ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
2922025-07-01T19:41:44.099ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
2932025-07-01T19:41:44.101ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 25dc216c-284d-4191-af96-58995bf80f21
2942025-07-01T19:41:44.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2952025-07-01T19:41:44.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2962025-07-01T19:41:44.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
2972025-07-01T19:41:44.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
2982025-07-01T19:41:44.919ZDEBGoximeter (results-sink): inserting 198 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
2992025-07-01T19:41:44.919ZDEBGoximeter (results-sink-cluster): inserting 198 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
3002025-07-01T19:41:44.919ZDEBGoximeter (clickhouse-client): unrolling 198 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
3012025-07-01T19:41:44.931ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 212 table_name = fields_i16
3022025-07-01T19:41:44.932ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 631 table_name = fields_string
3032025-07-01T19:41:44.934ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 128 table_name = fields_u16
3042025-07-01T19:41:44.935ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 113 table_name = fields_u32
3052025-07-01T19:41:44.937ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 112 table_name = fields_u8
3062025-07-01T19:41:44.938ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 368 table_name = fields_uuid
3072025-07-01T19:41:44.940ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 6 table_name = measurements_bool
3082025-07-01T19:41:44.941ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 127 table_name = measurements_cumulativeu64
3092025-07-01T19:41:44.942ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 1 table_name = measurements_f64
3102025-07-01T19:41:44.944ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 22 table_name = measurements_histogramu64
3112025-07-01T19:41:44.946ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 42 table_name = measurements_u64
3122025-07-01T19:41:45.020ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
3132025-07-01T19:41:45.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3142025-07-01T19:41:45.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3152025-07-01T19:41:45.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3162025-07-01T19:41:46.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3172025-07-01T19:41:46.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3182025-07-01T19:41:46.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3192025-07-01T19:41:47.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3202025-07-01T19:41:47.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3212025-07-01T19:41:47.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3222025-07-01T19:41:48.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3232025-07-01T19:41:48.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3242025-07-01T19:41:48.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3252025-07-01T19:41:49.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3262025-07-01T19:41:49.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3272025-07-01T19:41:49.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3282025-07-01T19:41:49.919ZDEBGoximeter (results-sink): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
3292025-07-01T19:41:49.919ZDEBGoximeter (results-sink-cluster): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
3302025-07-01T19:41:49.919ZDEBGoximeter (clickhouse-client): unrolling 70 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
3312025-07-01T19:41:49.923ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 26 table_name = fields_string
3322025-07-01T19:41:49.925ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 28 table_name = fields_uuid
3332025-07-01T19:41:49.926ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 50 table_name = measurements_cumulativeu64
3342025-07-01T19:41:49.927ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 20 table_name = measurements_u64
3352025-07-01T19:41:50.020ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
3362025-07-01T19:41:50.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3372025-07-01T19:41:50.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3382025-07-01T19:41:50.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3392025-07-01T19:41:51.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3402025-07-01T19:41:51.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3412025-07-01T19:41:51.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3422025-07-01T19:41:52.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3432025-07-01T19:41:52.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3442025-07-01T19:41:52.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3452025-07-01T19:41:53.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3462025-07-01T19:41:53.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3472025-07-01T19:41:53.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3482025-07-01T19:41:54.097ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
3492025-07-01T19:41:54.097ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
3502025-07-01T19:41:54.099ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
3512025-07-01T19:41:54.099ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
3522025-07-01T19:41:54.100ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 25dc216c-284d-4191-af96-58995bf80f21
3532025-07-01T19:41:54.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3542025-07-01T19:41:54.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3552025-07-01T19:41:54.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3562025-07-01T19:41:54.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
3572025-07-01T19:41:54.919ZDEBGoximeter (results-sink): inserting 198 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
3582025-07-01T19:41:54.920ZDEBGoximeter (results-sink-cluster): inserting 198 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
3592025-07-01T19:41:54.920ZDEBGoximeter (clickhouse-client): unrolling 198 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
3602025-07-01T19:41:54.931ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 212 table_name = fields_i16
3612025-07-01T19:41:54.932ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 631 table_name = fields_string
3622025-07-01T19:41:54.934ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 128 table_name = fields_u16
3632025-07-01T19:41:54.935ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 113 table_name = fields_u32
3642025-07-01T19:41:54.936ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 112 table_name = fields_u8
3652025-07-01T19:41:54.938ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 368 table_name = fields_uuid
3662025-07-01T19:41:54.939ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 6 table_name = measurements_bool
3672025-07-01T19:41:54.941ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 127 table_name = measurements_cumulativeu64
3682025-07-01T19:41:54.942ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 1 table_name = measurements_f64
3692025-07-01T19:41:54.944ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 22 table_name = measurements_histogramu64
3702025-07-01T19:41:54.945ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 42 table_name = measurements_u64
3712025-07-01T19:41:55.020ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
3722025-07-01T19:41:55.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3732025-07-01T19:41:55.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3742025-07-01T19:41:55.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3752025-07-01T19:41:56.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3762025-07-01T19:41:56.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3772025-07-01T19:41:56.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3782025-07-01T19:41:57.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3792025-07-01T19:41:57.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3802025-07-01T19:41:57.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3812025-07-01T19:41:58.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3822025-07-01T19:41:58.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3832025-07-01T19:41:58.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3842025-07-01T19:41:59.071ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
3852025-07-01T19:41:59.071ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending
3862025-07-01T19:41:59.075ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "19dedfe9-8fd8-4784-bfab-156fc1a67be5", "content-length": "574", "date": "Tue, 01 Jul 2025 19:41:59 GMT"} })
3872025-07-01T19:41:59.075ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkODM0YzFiMS1iMDRlLTRkZDUtOGU4OC1lYzhhYTBlMjk0YmQifX0%3D
3882025-07-01T19:41:59.078ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkODM0YzFiMS1iMDRlLTRkZDUtOGU4OC1lYzhhYTBlMjk0YmQifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "97656787-d581-4e61-a4ec-173b467a86e8", "content-length": "29", "date": "Tue, 01 Jul 2025 19:41:59 GMT"} })
3892025-07-01T19:41:59.078ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:637 n_current_tasks = 3 n_pruned_tasks = 0
3902025-07-01T19:41:59.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3912025-07-01T19:41:59.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3922025-07-01T19:41:59.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
3932025-07-01T19:41:59.919ZDEBGoximeter (results-sink): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
3942025-07-01T19:41:59.920ZDEBGoximeter (results-sink-cluster): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
3952025-07-01T19:41:59.920ZDEBGoximeter (clickhouse-client): unrolling 70 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
3962025-07-01T19:41:59.925ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 26 table_name = fields_string
3972025-07-01T19:41:59.926ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 28 table_name = fields_uuid
3982025-07-01T19:41:59.927ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 50 table_name = measurements_cumulativeu64
3992025-07-01T19:41:59.929ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 20 table_name = measurements_u64
4002025-07-01T19:42:00.020ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
4012025-07-01T19:42:00.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4022025-07-01T19:42:00.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4032025-07-01T19:42:00.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4042025-07-01T19:42:01.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4052025-07-01T19:42:01.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4062025-07-01T19:42:01.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4072025-07-01T19:42:02.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4082025-07-01T19:42:02.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4092025-07-01T19:42:02.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4102025-07-01T19:42:03.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4112025-07-01T19:42:03.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4122025-07-01T19:42:03.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4132025-07-01T19:42:04.097ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
4142025-07-01T19:42:04.097ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
4152025-07-01T19:42:04.100ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
4162025-07-01T19:42:04.100ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
4172025-07-01T19:42:04.101ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 25dc216c-284d-4191-af96-58995bf80f21
4182025-07-01T19:42:04.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4192025-07-01T19:42:04.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4202025-07-01T19:42:04.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4212025-07-01T19:42:04.112ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
4222025-07-01T19:42:04.920ZDEBGoximeter (results-sink): inserting 199 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
4232025-07-01T19:42:04.920ZDEBGoximeter (results-sink-cluster): inserting 199 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
4242025-07-01T19:42:04.920ZDEBGoximeter (clickhouse-client): unrolling 199 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
4252025-07-01T19:42:04.932ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 212 table_name = fields_i16
4262025-07-01T19:42:04.934ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 633 table_name = fields_string
4272025-07-01T19:42:04.936ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 129 table_name = fields_u16
4282025-07-01T19:42:04.937ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 113 table_name = fields_u32
4292025-07-01T19:42:04.939ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 112 table_name = fields_u8
4302025-07-01T19:42:04.940ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 369 table_name = fields_uuid
4312025-07-01T19:42:04.942ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 6 table_name = measurements_bool
4322025-07-01T19:42:04.943ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 127 table_name = measurements_cumulativeu64
4332025-07-01T19:42:04.944ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 1 table_name = measurements_f64
4342025-07-01T19:42:04.946ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 23 table_name = measurements_histogramu64
4352025-07-01T19:42:04.948ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 42 table_name = measurements_u64
4362025-07-01T19:42:05.021ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
4372025-07-01T19:42:05.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4382025-07-01T19:42:05.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4392025-07-01T19:42:05.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4402025-07-01T19:42:06.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4412025-07-01T19:42:06.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4422025-07-01T19:42:06.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4432025-07-01T19:42:07.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4442025-07-01T19:42:07.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4452025-07-01T19:42:07.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4462025-07-01T19:42:08.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4472025-07-01T19:42:08.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4482025-07-01T19:42:08.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4492025-07-01T19:42:09.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4502025-07-01T19:42:09.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4512025-07-01T19:42:09.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4522025-07-01T19:42:09.919ZDEBGoximeter (results-sink): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
4532025-07-01T19:42:09.919ZDEBGoximeter (results-sink-cluster): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
4542025-07-01T19:42:09.919ZDEBGoximeter (clickhouse-client): unrolling 70 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
4552025-07-01T19:42:09.924ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 26 table_name = fields_string
4562025-07-01T19:42:09.926ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 28 table_name = fields_uuid
4572025-07-01T19:42:09.927ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 50 table_name = measurements_cumulativeu64
4582025-07-01T19:42:09.929ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 20 table_name = measurements_u64
4592025-07-01T19:42:10.021ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
4602025-07-01T19:42:10.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4612025-07-01T19:42:10.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4622025-07-01T19:42:10.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4632025-07-01T19:42:11.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4642025-07-01T19:42:11.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4652025-07-01T19:42:11.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4662025-07-01T19:42:12.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4672025-07-01T19:42:12.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4682025-07-01T19:42:12.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4692025-07-01T19:42:13.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4702025-07-01T19:42:13.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4712025-07-01T19:42:13.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4722025-07-01T19:42:14.071ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
4732025-07-01T19:42:14.071ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending
4742025-07-01T19:42:14.075ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4f5a84c-b64c-4bad-b549-20f6e49167dc", "content-length": "991", "date": "Tue, 01 Jul 2025 19:42:13 GMT"} })
4752025-07-01T19:42:14.075ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D
4762025-07-01T19:42:14.077ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "b94d42b2-70c0-4cb2-bcd5-98803723cfe5", "content-length": "29", "date": "Tue, 01 Jul 2025 19:42:13 GMT"} })
4772025-07-01T19:42:14.077ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:47568 collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
4782025-07-01T19:42:14.079ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:41518 collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = e11276c4-5a36-4c10-8407-432ae47cf5cf
4792025-07-01T19:42:14.081ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:58600 collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
4802025-07-01T19:42:14.083ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:637 n_current_tasks = 6 n_pruned_tasks = 0
4812025-07-01T19:42:14.097ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
4822025-07-01T19:42:14.097ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
4832025-07-01T19:42:14.098ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
4842025-07-01T19:42:14.100ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
4852025-07-01T19:42:14.101ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
4862025-07-01T19:42:14.101ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
4872025-07-01T19:42:14.102ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 25dc216c-284d-4191-af96-58995bf80f21
4882025-07-01T19:42:14.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4892025-07-01T19:42:14.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4902025-07-01T19:42:14.103ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4912025-07-01T19:42:14.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
4922025-07-01T19:42:14.111ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
4932025-07-01T19:42:14.919ZDEBGoximeter (results-sink): inserting 202 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
4942025-07-01T19:42:14.919ZDEBGoximeter (results-sink-cluster): inserting 202 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
4952025-07-01T19:42:14.919ZDEBGoximeter (clickhouse-client): unrolling 202 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
4962025-07-01T19:42:14.922ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
4972025-07-01T19:42:14.929ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:42:14.922031403Z } timeseries_name = oximeter_collector:collections
4982025-07-01T19:42:14.937ZDEBGoximeter (clickhouse-client): inserting 1 new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
4992025-07-01T19:42:14.940ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 212 table_name = fields_i16
5002025-07-01T19:42:14.941ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 6 table_name = fields_ipaddr
5012025-07-01T19:42:14.943ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 636 table_name = fields_string
5022025-07-01T19:42:14.944ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 135 table_name = fields_u16
5032025-07-01T19:42:14.946ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 113 table_name = fields_u32
5042025-07-01T19:42:14.947ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 112 table_name = fields_u8
5052025-07-01T19:42:14.949ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 375 table_name = fields_uuid
5062025-07-01T19:42:14.950ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 6 table_name = measurements_bool
5072025-07-01T19:42:14.952ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 130 table_name = measurements_cumulativeu64
5082025-07-01T19:42:14.953ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 1 table_name = measurements_f64
5092025-07-01T19:42:14.955ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 23 table_name = measurements_histogramu64
5102025-07-01T19:42:14.956ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 42 table_name = measurements_u64
5112025-07-01T19:42:15.020ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
5122025-07-01T19:42:15.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5132025-07-01T19:42:15.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5142025-07-01T19:42:15.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5152025-07-01T19:42:16.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5162025-07-01T19:42:16.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5172025-07-01T19:42:16.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5182025-07-01T19:42:17.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5192025-07-01T19:42:17.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5202025-07-01T19:42:17.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5212025-07-01T19:42:18.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5222025-07-01T19:42:18.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5232025-07-01T19:42:18.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5242025-07-01T19:42:19.102ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5252025-07-01T19:42:19.102ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5262025-07-01T19:42:19.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5272025-07-01T19:42:19.920ZDEBGoximeter (results-sink): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
5282025-07-01T19:42:19.920ZDEBGoximeter (results-sink-cluster): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
5292025-07-01T19:42:19.920ZDEBGoximeter (clickhouse-client): unrolling 70 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
5302025-07-01T19:42:19.926ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 26 table_name = fields_string
5312025-07-01T19:42:19.927ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 28 table_name = fields_uuid
5322025-07-01T19:42:19.928ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 50 table_name = measurements_cumulativeu64
5332025-07-01T19:42:19.929ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 20 table_name = measurements_u64
5342025-07-01T19:42:20.022ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
5352025-07-01T19:42:20.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5362025-07-01T19:42:20.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5372025-07-01T19:42:20.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5382025-07-01T19:42:21.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5392025-07-01T19:42:21.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5402025-07-01T19:42:21.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5412025-07-01T19:42:22.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5422025-07-01T19:42:22.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5432025-07-01T19:42:22.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5442025-07-01T19:42:23.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5452025-07-01T19:42:23.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5462025-07-01T19:42:23.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5472025-07-01T19:42:24.079ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
5482025-07-01T19:42:24.079ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
5492025-07-01T19:42:24.083ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
5502025-07-01T19:42:24.083ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
5512025-07-01T19:42:24.092ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
5522025-07-01T19:42:24.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
5532025-07-01T19:42:24.098ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
5542025-07-01T19:42:24.098ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
5552025-07-01T19:42:24.100ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
5562025-07-01T19:42:24.100ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
5572025-07-01T19:42:24.101ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 25dc216c-284d-4191-af96-58995bf80f21
5582025-07-01T19:42:24.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5592025-07-01T19:42:24.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5602025-07-01T19:42:24.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5612025-07-01T19:42:24.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
5622025-07-01T19:42:24.920ZDEBGoximeter (results-sink): inserting 218 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
5632025-07-01T19:42:24.920ZDEBGoximeter (results-sink-cluster): inserting 218 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
5642025-07-01T19:42:24.920ZDEBGoximeter (clickhouse-client): unrolling 218 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
5652025-07-01T19:42:24.923ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
5662025-07-01T19:42:24.926ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("database_transaction:retry_data"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "attempt", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:42:24.923089515Z } timeseries_name = database_transaction:retry_data
5672025-07-01T19:42:24.933ZDEBGoximeter (clickhouse-client): inserting 1 new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
5682025-07-01T19:42:24.936ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 212 table_name = fields_i16
5692025-07-01T19:42:24.938ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 652 table_name = fields_string
5702025-07-01T19:42:24.939ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 138 table_name = fields_u16
5712025-07-01T19:42:24.940ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 114 table_name = fields_u32
5722025-07-01T19:42:24.942ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 112 table_name = fields_u8
5732025-07-01T19:42:24.943ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 387 table_name = fields_uuid
5742025-07-01T19:42:24.944ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 6 table_name = measurements_bool
5752025-07-01T19:42:24.946ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 127 table_name = measurements_cumulativeu64
5762025-07-01T19:42:24.947ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 2 table_name = measurements_f64
5772025-07-01T19:42:24.949ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 32 table_name = measurements_histogramu64
5782025-07-01T19:42:24.950ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 9 table_name = measurements_i64
5792025-07-01T19:42:24.952ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 42 table_name = measurements_u64
5802025-07-01T19:42:25.021ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
5812025-07-01T19:42:25.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5822025-07-01T19:42:25.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5832025-07-01T19:42:25.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5842025-07-01T19:42:26.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5852025-07-01T19:42:26.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5862025-07-01T19:42:26.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5872025-07-01T19:42:27.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5882025-07-01T19:42:27.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5892025-07-01T19:42:27.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5902025-07-01T19:42:28.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5912025-07-01T19:42:28.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5922025-07-01T19:42:28.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
5932025-07-01T19:42:29.072ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
5942025-07-01T19:42:29.072ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending
5952025-07-01T19:42:29.075ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "7aa85cc2-a907-431c-8b23-a3bfd4918ece", "content-length": "991", "date": "Tue, 01 Jul 2025 19:42:29 GMT"} })
5962025-07-01T19:42:29.075ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D
5972025-07-01T19:42:29.078ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4eb9c2f-ed19-474a-b48f-48f6abc8efe0", "content-length": "29", "date": "Tue, 01 Jul 2025 19:42:29 GMT"} })
5982025-07-01T19:42:29.078ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:637 n_current_tasks = 6 n_pruned_tasks = 0
5992025-07-01T19:42:29.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6002025-07-01T19:42:29.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6012025-07-01T19:42:29.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6022025-07-01T19:42:29.920ZDEBGoximeter (results-sink): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
6032025-07-01T19:42:29.920ZDEBGoximeter (results-sink-cluster): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
6042025-07-01T19:42:29.920ZDEBGoximeter (clickhouse-client): unrolling 70 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
6052025-07-01T19:42:29.925ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 26 table_name = fields_string
6062025-07-01T19:42:29.926ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 28 table_name = fields_uuid
6072025-07-01T19:42:29.928ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 50 table_name = measurements_cumulativeu64
6082025-07-01T19:42:29.929ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 20 table_name = measurements_u64
6092025-07-01T19:42:30.021ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
6102025-07-01T19:42:30.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6112025-07-01T19:42:30.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6122025-07-01T19:42:30.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6132025-07-01T19:42:31.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6142025-07-01T19:42:31.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6152025-07-01T19:42:31.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6162025-07-01T19:42:32.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6172025-07-01T19:42:32.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6182025-07-01T19:42:32.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6192025-07-01T19:42:33.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6202025-07-01T19:42:33.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6212025-07-01T19:42:33.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6222025-07-01T19:42:34.079ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
6232025-07-01T19:42:34.079ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
6242025-07-01T19:42:34.080ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
6252025-07-01T19:42:34.083ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
6262025-07-01T19:42:34.083ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
6272025-07-01T19:42:34.084ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
6282025-07-01T19:42:34.098ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
6292025-07-01T19:42:34.098ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
6302025-07-01T19:42:34.100ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
6312025-07-01T19:42:34.100ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
6322025-07-01T19:42:34.102ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 25dc216c-284d-4191-af96-58995bf80f21
6332025-07-01T19:42:34.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6342025-07-01T19:42:34.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6352025-07-01T19:42:34.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6362025-07-01T19:42:34.109ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
6372025-07-01T19:42:34.920ZDEBGoximeter (results-sink): inserting 208 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
6382025-07-01T19:42:34.920ZDEBGoximeter (results-sink-cluster): inserting 208 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
6392025-07-01T19:42:34.920ZDEBGoximeter (clickhouse-client): unrolling 208 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
6402025-07-01T19:42:34.932ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 212 table_name = fields_i16
6412025-07-01T19:42:34.934ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 651 table_name = fields_string
6422025-07-01T19:42:34.936ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 138 table_name = fields_u16
6432025-07-01T19:42:34.937ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 113 table_name = fields_u32
6442025-07-01T19:42:34.939ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 112 table_name = fields_u8
6452025-07-01T19:42:34.940ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 378 table_name = fields_uuid
6462025-07-01T19:42:34.941ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 6 table_name = measurements_bool
6472025-07-01T19:42:34.943ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 127 table_name = measurements_cumulativeu64
6482025-07-01T19:42:34.944ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 1 table_name = measurements_f64
6492025-07-01T19:42:34.947ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 32 table_name = measurements_histogramu64
6502025-07-01T19:42:34.948ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 42 table_name = measurements_u64
6512025-07-01T19:42:35.021ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
6522025-07-01T19:42:35.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6532025-07-01T19:42:35.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6542025-07-01T19:42:35.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6552025-07-01T19:42:36.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6562025-07-01T19:42:36.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6572025-07-01T19:42:36.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6582025-07-01T19:42:37.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6592025-07-01T19:42:37.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6602025-07-01T19:42:37.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6612025-07-01T19:42:38.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6622025-07-01T19:42:38.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6632025-07-01T19:42:38.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6642025-07-01T19:42:39.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6652025-07-01T19:42:39.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6662025-07-01T19:42:39.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6672025-07-01T19:42:39.920ZDEBGoximeter (results-sink): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
6682025-07-01T19:42:39.920ZDEBGoximeter (results-sink-cluster): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
6692025-07-01T19:42:39.920ZDEBGoximeter (clickhouse-client): unrolling 70 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
6702025-07-01T19:42:39.925ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 26 table_name = fields_string
6712025-07-01T19:42:39.926ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 28 table_name = fields_uuid
6722025-07-01T19:42:39.928ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 50 table_name = measurements_cumulativeu64
6732025-07-01T19:42:39.929ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 20 table_name = measurements_u64
6742025-07-01T19:42:40.021ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
6752025-07-01T19:42:40.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6762025-07-01T19:42:40.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6772025-07-01T19:42:40.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6782025-07-01T19:42:41.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6792025-07-01T19:42:41.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6802025-07-01T19:42:41.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6812025-07-01T19:42:42.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6822025-07-01T19:42:42.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6832025-07-01T19:42:42.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6842025-07-01T19:42:43.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6852025-07-01T19:42:43.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6862025-07-01T19:42:43.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
6872025-07-01T19:42:44.072ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
6882025-07-01T19:42:44.072ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending
6892025-07-01T19:42:44.076ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "62022726-fd74-4cd8-ac86-cbdd33628856", "content-length": "991", "date": "Tue, 01 Jul 2025 19:42:44 GMT"} })
6902025-07-01T19:42:44.076ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D
6912025-07-01T19:42:44.079ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c2d9832-3bc8-4587-98c3-e9ae5a5c1885", "content-length": "29", "date": "Tue, 01 Jul 2025 19:42:44 GMT"} })
6922025-07-01T19:42:44.079ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:637 n_current_tasks = 6 n_pruned_tasks = 0
6932025-07-01T19:42:44.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
6942025-07-01T19:42:44.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
6952025-07-01T19:42:44.081ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
6962025-07-01T19:42:44.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = e11276c4-5a36-4c10-8407-432ae47cf5cf
6972025-07-01T19:42:44.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = e11276c4-5a36-4c10-8407-432ae47cf5cf
6982025-07-01T19:42:44.083ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
6992025-07-01T19:42:44.083ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
7002025-07-01T19:42:44.084ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
7012025-07-01T19:42:44.088ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = e11276c4-5a36-4c10-8407-432ae47cf5cf
7022025-07-01T19:42:44.099ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
7032025-07-01T19:42:44.099ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
7042025-07-01T19:42:44.100ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
7052025-07-01T19:42:44.100ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
7062025-07-01T19:42:44.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 25dc216c-284d-4191-af96-58995bf80f21
7072025-07-01T19:42:44.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7082025-07-01T19:42:44.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7092025-07-01T19:42:44.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7102025-07-01T19:42:44.109ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
7112025-07-01T19:42:44.921ZDEBGoximeter (results-sink): inserting 244 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
7122025-07-01T19:42:44.921ZDEBGoximeter (results-sink-cluster): inserting 244 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
7132025-07-01T19:42:44.921ZDEBGoximeter (clickhouse-client): unrolling 244 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
7142025-07-01T19:42:44.923ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
7152025-07-01T19:42:44.926ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("kstat_sampler:expired_targets"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:42:44.923684111Z } timeseries_name = kstat_sampler:expired_targets
7162025-07-01T19:42:44.935ZDEBGoximeter (clickhouse-client): inserting 1 new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
7172025-07-01T19:42:44.938ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 212 table_name = fields_i16
7182025-07-01T19:42:44.940ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 652 table_name = fields_string
7192025-07-01T19:42:44.942ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 138 table_name = fields_u16
7202025-07-01T19:42:44.943ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 113 table_name = fields_u32
7212025-07-01T19:42:44.945ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 112 table_name = fields_u8
7222025-07-01T19:42:44.946ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 378 table_name = fields_uuid
7232025-07-01T19:42:44.948ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 6 table_name = measurements_bool
7242025-07-01T19:42:44.949ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 163 table_name = measurements_cumulativeu64
7252025-07-01T19:42:44.950ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 1 table_name = measurements_f64
7262025-07-01T19:42:44.952ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 32 table_name = measurements_histogramu64
7272025-07-01T19:42:44.954ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 42 table_name = measurements_u64
7282025-07-01T19:42:45.022ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
7292025-07-01T19:42:45.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7302025-07-01T19:42:45.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7312025-07-01T19:42:45.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7322025-07-01T19:42:46.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7332025-07-01T19:42:46.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7342025-07-01T19:42:46.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7352025-07-01T19:42:47.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7362025-07-01T19:42:47.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7372025-07-01T19:42:47.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7382025-07-01T19:42:48.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7392025-07-01T19:42:48.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7402025-07-01T19:42:48.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7412025-07-01T19:42:49.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7422025-07-01T19:42:49.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7432025-07-01T19:42:49.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7442025-07-01T19:42:49.920ZDEBGoximeter (results-sink): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
7452025-07-01T19:42:49.920ZDEBGoximeter (results-sink-cluster): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
7462025-07-01T19:42:49.920ZDEBGoximeter (clickhouse-client): unrolling 70 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
7472025-07-01T19:42:49.925ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 26 table_name = fields_string
7482025-07-01T19:42:49.926ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 28 table_name = fields_uuid
7492025-07-01T19:42:49.928ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 50 table_name = measurements_cumulativeu64
7502025-07-01T19:42:49.929ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 20 table_name = measurements_u64
7512025-07-01T19:42:50.021ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
7522025-07-01T19:42:50.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7532025-07-01T19:42:50.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7542025-07-01T19:42:50.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7552025-07-01T19:42:51.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7562025-07-01T19:42:51.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7572025-07-01T19:42:51.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7582025-07-01T19:42:52.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7592025-07-01T19:42:52.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7602025-07-01T19:42:52.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7612025-07-01T19:42:53.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7622025-07-01T19:42:53.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7632025-07-01T19:42:53.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7642025-07-01T19:42:54.079ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
7652025-07-01T19:42:54.079ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
7662025-07-01T19:42:54.081ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
7672025-07-01T19:42:54.083ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
7682025-07-01T19:42:54.083ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
7692025-07-01T19:42:54.084ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
7702025-07-01T19:42:54.098ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
7712025-07-01T19:42:54.098ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
7722025-07-01T19:42:54.100ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
7732025-07-01T19:42:54.100ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
7742025-07-01T19:42:54.102ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 25dc216c-284d-4191-af96-58995bf80f21
7752025-07-01T19:42:54.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7762025-07-01T19:42:54.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7772025-07-01T19:42:54.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7782025-07-01T19:42:54.109ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
7792025-07-01T19:42:54.920ZDEBGoximeter (results-sink): inserting 208 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
7802025-07-01T19:42:54.920ZDEBGoximeter (results-sink-cluster): inserting 208 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
7812025-07-01T19:42:54.920ZDEBGoximeter (clickhouse-client): unrolling 208 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
7822025-07-01T19:42:54.933ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 212 table_name = fields_i16
7832025-07-01T19:42:54.935ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 651 table_name = fields_string
7842025-07-01T19:42:54.936ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 138 table_name = fields_u16
7852025-07-01T19:42:54.938ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 113 table_name = fields_u32
7862025-07-01T19:42:54.939ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 112 table_name = fields_u8
7872025-07-01T19:42:54.941ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 378 table_name = fields_uuid
7882025-07-01T19:42:54.942ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 6 table_name = measurements_bool
7892025-07-01T19:42:54.943ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 127 table_name = measurements_cumulativeu64
7902025-07-01T19:42:54.945ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 1 table_name = measurements_f64
7912025-07-01T19:42:54.947ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 32 table_name = measurements_histogramu64
7922025-07-01T19:42:54.948ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 42 table_name = measurements_u64
7932025-07-01T19:42:55.021ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
7942025-07-01T19:42:55.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7952025-07-01T19:42:55.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7962025-07-01T19:42:55.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7972025-07-01T19:42:56.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7982025-07-01T19:42:56.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
7992025-07-01T19:42:56.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8002025-07-01T19:42:57.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8012025-07-01T19:42:57.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8022025-07-01T19:42:57.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8032025-07-01T19:42:58.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8042025-07-01T19:42:58.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8052025-07-01T19:42:58.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8062025-07-01T19:42:59.072ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
8072025-07-01T19:42:59.072ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending
8082025-07-01T19:42:59.075ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "72e0a166-704f-4894-a05a-9f8394d80262", "content-length": "991", "date": "Tue, 01 Jul 2025 19:42:59 GMT"} })
8092025-07-01T19:42:59.075ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D
8102025-07-01T19:42:59.078ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "2dffb98f-8804-4819-a349-1555db836e51", "content-length": "29", "date": "Tue, 01 Jul 2025 19:42:59 GMT"} })
8112025-07-01T19:42:59.078ZDEBGoximeter (oximeter-agent): received request to register existing metric producer, updating collection information address = [fd00:1122:3344:101::2]:35992 collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d interval = 30s producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
8122025-07-01T19:42:59.078ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:637 n_current_tasks = 6 n_pruned_tasks = 0
8132025-07-01T19:42:59.078ZDEBGoximeter (collection-task): collection task received request to update its producer information address = [fd00:1122:3344:101::2]:35992 collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d interval = 30s producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
8142025-07-01T19:42:59.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8152025-07-01T19:42:59.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8162025-07-01T19:42:59.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8172025-07-01T19:42:59.920ZDEBGoximeter (results-sink): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
8182025-07-01T19:42:59.921ZDEBGoximeter (results-sink-cluster): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
8192025-07-01T19:42:59.921ZDEBGoximeter (clickhouse-client): unrolling 70 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
8202025-07-01T19:42:59.925ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 26 table_name = fields_string
8212025-07-01T19:42:59.927ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 28 table_name = fields_uuid
8222025-07-01T19:42:59.928ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 50 table_name = measurements_cumulativeu64
8232025-07-01T19:42:59.929ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 20 table_name = measurements_u64
8242025-07-01T19:43:00.022ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
8252025-07-01T19:43:00.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8262025-07-01T19:43:00.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8272025-07-01T19:43:00.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8282025-07-01T19:43:01.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8292025-07-01T19:43:01.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8302025-07-01T19:43:01.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8312025-07-01T19:43:02.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8322025-07-01T19:43:02.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8332025-07-01T19:43:02.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8342025-07-01T19:43:03.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8352025-07-01T19:43:03.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8362025-07-01T19:43:03.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8372025-07-01T19:43:04.079ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
8382025-07-01T19:43:04.079ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
8392025-07-01T19:43:04.081ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
8402025-07-01T19:43:04.083ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
8412025-07-01T19:43:04.083ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
8422025-07-01T19:43:04.084ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
8432025-07-01T19:43:04.099ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
8442025-07-01T19:43:04.099ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
8452025-07-01T19:43:04.102ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 25dc216c-284d-4191-af96-58995bf80f21
8462025-07-01T19:43:04.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8472025-07-01T19:43:04.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8482025-07-01T19:43:04.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8492025-07-01T19:43:04.920ZDEBGoximeter (results-sink): inserting 102 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
8502025-07-01T19:43:04.921ZDEBGoximeter (results-sink-cluster): inserting 102 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
8512025-07-01T19:43:04.921ZDEBGoximeter (clickhouse-client): unrolling 102 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
8522025-07-01T19:43:04.927ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 90 table_name = fields_string
8532025-07-01T19:43:04.929ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 32 table_name = fields_u16
8542025-07-01T19:43:04.930ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 60 table_name = fields_uuid
8552025-07-01T19:43:04.931ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 50 table_name = measurements_cumulativeu64
8562025-07-01T19:43:04.934ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 32 table_name = measurements_histogramu64
8572025-07-01T19:43:04.935ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 20 table_name = measurements_u64
8582025-07-01T19:43:05.021ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
8592025-07-01T19:43:05.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8602025-07-01T19:43:05.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8612025-07-01T19:43:05.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8622025-07-01T19:43:06.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8632025-07-01T19:43:06.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8642025-07-01T19:43:06.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8652025-07-01T19:43:07.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8662025-07-01T19:43:07.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8672025-07-01T19:43:07.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8682025-07-01T19:43:08.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8692025-07-01T19:43:08.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8702025-07-01T19:43:08.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8712025-07-01T19:43:09.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8722025-07-01T19:43:09.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8732025-07-01T19:43:09.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8742025-07-01T19:43:09.920ZDEBGoximeter (results-sink): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
8752025-07-01T19:43:09.921ZDEBGoximeter (results-sink-cluster): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
8762025-07-01T19:43:09.921ZDEBGoximeter (clickhouse-client): unrolling 70 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
8772025-07-01T19:43:09.925ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 26 table_name = fields_string
8782025-07-01T19:43:09.927ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 28 table_name = fields_uuid
8792025-07-01T19:43:09.928ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 50 table_name = measurements_cumulativeu64
8802025-07-01T19:43:09.929ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 20 table_name = measurements_u64
8812025-07-01T19:43:10.022ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
8822025-07-01T19:43:10.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8832025-07-01T19:43:10.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8842025-07-01T19:43:10.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8852025-07-01T19:43:11.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8862025-07-01T19:43:11.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8872025-07-01T19:43:11.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8882025-07-01T19:43:12.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8892025-07-01T19:43:12.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8902025-07-01T19:43:12.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8912025-07-01T19:43:13.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8922025-07-01T19:43:13.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8932025-07-01T19:43:13.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
8942025-07-01T19:43:14.072ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
8952025-07-01T19:43:14.072ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending
8962025-07-01T19:43:14.076ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "17cf3750-2159-4d2b-a42a-f7b4c062eb4d", "content-length": "991", "date": "Tue, 01 Jul 2025 19:43:14 GMT"} })
8972025-07-01T19:43:14.076ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D
8982025-07-01T19:43:14.079ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f7426c4-c9c4-4700-9465-eee87714dc45", "content-length": "29", "date": "Tue, 01 Jul 2025 19:43:14 GMT"} })
8992025-07-01T19:43:14.079ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:637 n_current_tasks = 6 n_pruned_tasks = 0
9002025-07-01T19:43:14.079ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
9012025-07-01T19:43:14.079ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
9022025-07-01T19:43:14.081ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
9032025-07-01T19:43:14.081ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
9042025-07-01T19:43:14.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = e11276c4-5a36-4c10-8407-432ae47cf5cf
9052025-07-01T19:43:14.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = e11276c4-5a36-4c10-8407-432ae47cf5cf
9062025-07-01T19:43:14.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = e11276c4-5a36-4c10-8407-432ae47cf5cf
9072025-07-01T19:43:14.083ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = e11276c4-5a36-4c10-8407-432ae47cf5cf
9082025-07-01T19:43:14.083ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
9092025-07-01T19:43:14.083ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
9102025-07-01T19:43:14.084ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
9112025-07-01T19:43:14.085ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
9122025-07-01T19:43:14.098ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
9132025-07-01T19:43:14.098ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
9142025-07-01T19:43:14.099ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
9152025-07-01T19:43:14.102ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 25dc216c-284d-4191-af96-58995bf80f21
9162025-07-01T19:43:14.102ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
9172025-07-01T19:43:14.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9182025-07-01T19:43:14.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9192025-07-01T19:43:14.105ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9202025-07-01T19:43:14.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9212025-07-01T19:43:14.920ZDEBGoximeter (results-sink): inserting 108 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
9222025-07-01T19:43:14.920ZDEBGoximeter (results-sink-cluster): inserting 108 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
9232025-07-01T19:43:14.920ZDEBGoximeter (clickhouse-client): unrolling 108 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
9242025-07-01T19:43:14.927ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 12 table_name = fields_ipaddr
9252025-07-01T19:43:14.928ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 96 table_name = fields_string
9262025-07-01T19:43:14.930ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 44 table_name = fields_u16
9272025-07-01T19:43:14.931ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 72 table_name = fields_uuid
9282025-07-01T19:43:14.932ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 56 table_name = measurements_cumulativeu64
9292025-07-01T19:43:14.934ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 32 table_name = measurements_histogramu64
9302025-07-01T19:43:14.935ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 20 table_name = measurements_u64
9312025-07-01T19:43:15.022ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
9322025-07-01T19:43:15.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9332025-07-01T19:43:15.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9342025-07-01T19:43:15.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9352025-07-01T19:43:16.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9362025-07-01T19:43:16.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9372025-07-01T19:43:16.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9382025-07-01T19:43:17.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9392025-07-01T19:43:17.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9402025-07-01T19:43:17.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9412025-07-01T19:43:18.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9422025-07-01T19:43:18.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9432025-07-01T19:43:18.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9442025-07-01T19:43:19.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9452025-07-01T19:43:19.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9462025-07-01T19:43:19.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9472025-07-01T19:43:19.921ZDEBGoximeter (results-sink): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
9482025-07-01T19:43:19.921ZDEBGoximeter (results-sink-cluster): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
9492025-07-01T19:43:19.921ZDEBGoximeter (clickhouse-client): unrolling 70 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
9502025-07-01T19:43:19.925ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 26 table_name = fields_string
9512025-07-01T19:43:19.927ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 28 table_name = fields_uuid
9522025-07-01T19:43:19.928ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 50 table_name = measurements_cumulativeu64
9532025-07-01T19:43:19.929ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 20 table_name = measurements_u64
9542025-07-01T19:43:20.021ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
9552025-07-01T19:43:20.103ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9562025-07-01T19:43:20.103ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9572025-07-01T19:43:20.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9582025-07-01T19:43:21.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9592025-07-01T19:43:21.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9602025-07-01T19:43:21.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9612025-07-01T19:43:22.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9622025-07-01T19:43:22.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9632025-07-01T19:43:22.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9642025-07-01T19:43:23.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9652025-07-01T19:43:23.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9662025-07-01T19:43:23.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9672025-07-01T19:43:24.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
9682025-07-01T19:43:24.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
9692025-07-01T19:43:24.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
9702025-07-01T19:43:24.084ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
9712025-07-01T19:43:24.084ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
9722025-07-01T19:43:24.085ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
9732025-07-01T19:43:24.099ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
9742025-07-01T19:43:24.099ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
9752025-07-01T19:43:24.102ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 25dc216c-284d-4191-af96-58995bf80f21
9762025-07-01T19:43:24.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9772025-07-01T19:43:24.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9782025-07-01T19:43:24.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9792025-07-01T19:43:24.921ZDEBGoximeter (results-sink): inserting 102 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
9802025-07-01T19:43:24.921ZDEBGoximeter (results-sink-cluster): inserting 102 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
9812025-07-01T19:43:24.921ZDEBGoximeter (clickhouse-client): unrolling 102 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
9822025-07-01T19:43:24.927ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 90 table_name = fields_string
9832025-07-01T19:43:24.929ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 32 table_name = fields_u16
9842025-07-01T19:43:24.930ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 60 table_name = fields_uuid
9852025-07-01T19:43:24.932ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 50 table_name = measurements_cumulativeu64
9862025-07-01T19:43:24.934ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 32 table_name = measurements_histogramu64
9872025-07-01T19:43:24.935ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 20 table_name = measurements_u64
9882025-07-01T19:43:25.022ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
9892025-07-01T19:43:25.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9902025-07-01T19:43:25.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9912025-07-01T19:43:25.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9922025-07-01T19:43:26.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9932025-07-01T19:43:26.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9942025-07-01T19:43:26.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9952025-07-01T19:43:27.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9962025-07-01T19:43:27.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9972025-07-01T19:43:27.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9982025-07-01T19:43:28.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
9992025-07-01T19:43:28.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10002025-07-01T19:43:28.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10012025-07-01T19:43:29.073ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
10022025-07-01T19:43:29.074ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending
10032025-07-01T19:43:29.076ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "8eb30d4a-aa5a-4979-b2ae-11196751aad2", "content-length": "991", "date": "Tue, 01 Jul 2025 19:43:29 GMT"} })
10042025-07-01T19:43:29.076ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D
10052025-07-01T19:43:29.079ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
10062025-07-01T19:43:29.079ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
10072025-07-01T19:43:29.079ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee714db7-b922-4c52-8bd4-b37abca7bfd4", "content-length": "29", "date": "Tue, 01 Jul 2025 19:43:29 GMT"} })
10082025-07-01T19:43:29.079ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:637 n_current_tasks = 6 n_pruned_tasks = 0
10092025-07-01T19:43:29.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10102025-07-01T19:43:29.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10112025-07-01T19:43:29.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10122025-07-01T19:43:29.134ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
10132025-07-01T19:43:29.921ZDEBGoximeter (results-sink): inserting 562 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
10142025-07-01T19:43:29.921ZDEBGoximeter (results-sink-cluster): inserting 562 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
10152025-07-01T19:43:29.921ZDEBGoximeter (clickhouse-client): unrolling 562 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
10162025-07-01T19:43:29.924ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
10172025-07-01T19:43:29.926ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:43:29.924223892Z } timeseries_name = switch_port_control_data_link:errors_received
10182025-07-01T19:43:29.926ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
10192025-07-01T19:43:29.928ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:43:29.926897595Z } timeseries_name = switch_port_control_data_link:errors_sent
10202025-07-01T19:43:29.928ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
10212025-07-01T19:43:29.930ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:43:29.928678810Z } timeseries_name = switch_port_control_data_link:bytes_received
10222025-07-01T19:43:29.930ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
10232025-07-01T19:43:29.932ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:43:29.930308233Z } timeseries_name = switch_port_control_data_link:packets_received
10242025-07-01T19:43:29.932ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
10252025-07-01T19:43:29.933ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:43:29.932123559Z } timeseries_name = switch_port_control_data_link:bytes_sent
10262025-07-01T19:43:29.933ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
10272025-07-01T19:43:29.935ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:43:29.933765322Z } timeseries_name = switch_port_control_data_link:packets_sent
10282025-07-01T19:43:29.955ZDEBGoximeter (clickhouse-client): inserting 6 new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
10292025-07-01T19:43:29.958ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 24 table_name = fields_i16
10302025-07-01T19:43:29.960ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 146 table_name = fields_string
10312025-07-01T19:43:29.961ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 12 table_name = fields_u16
10322025-07-01T19:43:29.962ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 24 table_name = fields_u32
10332025-07-01T19:43:29.964ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 12 table_name = fields_u8
10342025-07-01T19:43:29.965ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 64 table_name = fields_uuid
10352025-07-01T19:43:29.967ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 542 table_name = measurements_cumulativeu64
10362025-07-01T19:43:29.968ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 20 table_name = measurements_u64
10372025-07-01T19:43:30.022ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
10382025-07-01T19:43:30.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10392025-07-01T19:43:30.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10402025-07-01T19:43:30.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10412025-07-01T19:43:31.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10422025-07-01T19:43:31.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10432025-07-01T19:43:31.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10442025-07-01T19:43:32.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10452025-07-01T19:43:32.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10462025-07-01T19:43:32.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10472025-07-01T19:43:33.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10482025-07-01T19:43:33.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10492025-07-01T19:43:33.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10502025-07-01T19:43:34.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
10512025-07-01T19:43:34.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
10522025-07-01T19:43:34.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
10532025-07-01T19:43:34.084ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
10542025-07-01T19:43:34.084ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
10552025-07-01T19:43:34.085ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
10562025-07-01T19:43:34.099ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
10572025-07-01T19:43:34.099ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
10582025-07-01T19:43:34.102ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 25dc216c-284d-4191-af96-58995bf80f21
10592025-07-01T19:43:34.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10602025-07-01T19:43:34.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10612025-07-01T19:43:34.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10622025-07-01T19:43:34.921ZDEBGoximeter (results-sink): inserting 102 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
10632025-07-01T19:43:34.921ZDEBGoximeter (results-sink-cluster): inserting 102 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
10642025-07-01T19:43:34.921ZDEBGoximeter (clickhouse-client): unrolling 102 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
10652025-07-01T19:43:34.927ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 90 table_name = fields_string
10662025-07-01T19:43:34.929ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 32 table_name = fields_u16
10672025-07-01T19:43:34.930ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 60 table_name = fields_uuid
10682025-07-01T19:43:34.932ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 50 table_name = measurements_cumulativeu64
10692025-07-01T19:43:34.934ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 32 table_name = measurements_histogramu64
10702025-07-01T19:43:34.935ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 20 table_name = measurements_u64
10712025-07-01T19:43:35.022ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
10722025-07-01T19:43:35.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10732025-07-01T19:43:35.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10742025-07-01T19:43:35.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10752025-07-01T19:43:36.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10762025-07-01T19:43:36.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10772025-07-01T19:43:36.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10782025-07-01T19:43:37.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10792025-07-01T19:43:37.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10802025-07-01T19:43:37.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10812025-07-01T19:43:38.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10822025-07-01T19:43:38.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10832025-07-01T19:43:38.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10842025-07-01T19:43:39.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10852025-07-01T19:43:39.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10862025-07-01T19:43:39.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10872025-07-01T19:43:39.921ZDEBGoximeter (results-sink): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
10882025-07-01T19:43:39.921ZDEBGoximeter (results-sink-cluster): inserting 70 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
10892025-07-01T19:43:39.921ZDEBGoximeter (clickhouse-client): unrolling 70 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
10902025-07-01T19:43:39.926ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 26 table_name = fields_string
10912025-07-01T19:43:39.927ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 28 table_name = fields_uuid
10922025-07-01T19:43:39.929ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 50 table_name = measurements_cumulativeu64
10932025-07-01T19:43:39.930ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 20 table_name = measurements_u64
10942025-07-01T19:43:40.022ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
10952025-07-01T19:43:40.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10962025-07-01T19:43:40.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10972025-07-01T19:43:40.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10982025-07-01T19:43:41.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
10992025-07-01T19:43:41.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11002025-07-01T19:43:41.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11012025-07-01T19:43:42.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11022025-07-01T19:43:42.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11032025-07-01T19:43:42.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11042025-07-01T19:43:43.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11052025-07-01T19:43:43.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11062025-07-01T19:43:43.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11072025-07-01T19:43:44.074ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
11082025-07-01T19:43:44.074ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending
11092025-07-01T19:43:44.077ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f8d1905-8906-4994-a8f9-0c1fa7d4f279", "content-length": "1276", "date": "Tue, 01 Jul 2025 19:43:44 GMT"} })
11102025-07-01T19:43:44.077ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D
11112025-07-01T19:43:44.080ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "58f0ef19-64da-47d1-8a02-0ab805e0c324", "content-length": "29", "date": "Tue, 01 Jul 2025 19:43:44 GMT"} })
11122025-07-01T19:43:44.080ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
11132025-07-01T19:43:44.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
11142025-07-01T19:43:44.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
11152025-07-01T19:43:44.081ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:45967 collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 4d3e94c8-ba98-4758-88a5-d77f8f70d343
11162025-07-01T19:43:44.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
11172025-07-01T19:43:44.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = e11276c4-5a36-4c10-8407-432ae47cf5cf
11182025-07-01T19:43:44.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = e11276c4-5a36-4c10-8407-432ae47cf5cf
11192025-07-01T19:43:44.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = e11276c4-5a36-4c10-8407-432ae47cf5cf
11202025-07-01T19:43:44.083ZDEBGoximeter (oximeter-agent): received request to register existing metric producer, updating collection information address = [fd00:1122:3344:101::2]:59411 collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
11212025-07-01T19:43:44.083ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:637 n_current_tasks = 8 n_pruned_tasks = 0
11222025-07-01T19:43:44.083ZDEBGoximeter (collection-task): collection task received request to update its producer information address = [fd00:1122:3344:101::2]:59411 collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
11232025-07-01T19:43:44.084ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
11242025-07-01T19:43:44.084ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
11252025-07-01T19:43:44.085ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
11262025-07-01T19:43:44.099ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
11272025-07-01T19:43:44.099ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
11282025-07-01T19:43:44.102ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 25dc216c-284d-4191-af96-58995bf80f21
11292025-07-01T19:43:44.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11302025-07-01T19:43:44.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11312025-07-01T19:43:44.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11322025-07-01T19:43:44.921ZDEBGoximeter (results-sink): inserting 102 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
11332025-07-01T19:43:44.922ZDEBGoximeter (results-sink-cluster): inserting 102 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
11342025-07-01T19:43:44.922ZDEBGoximeter (clickhouse-client): unrolling 102 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
11352025-07-01T19:43:44.928ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 90 table_name = fields_string
11362025-07-01T19:43:44.929ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 32 table_name = fields_u16
11372025-07-01T19:43:44.931ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 60 table_name = fields_uuid
11382025-07-01T19:43:44.933ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 50 table_name = measurements_cumulativeu64
11392025-07-01T19:43:44.935ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 32 table_name = measurements_histogramu64
11402025-07-01T19:43:44.936ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 20 table_name = measurements_u64
11412025-07-01T19:43:45.022ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
11422025-07-01T19:43:45.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
11432025-07-01T19:43:45.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
11442025-07-01T19:43:45.088ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
11452025-07-01T19:43:45.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11462025-07-01T19:43:45.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11472025-07-01T19:43:45.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11482025-07-01T19:43:46.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
11492025-07-01T19:43:46.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
11502025-07-01T19:43:46.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
11512025-07-01T19:43:46.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11522025-07-01T19:43:46.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11532025-07-01T19:43:46.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11542025-07-01T19:43:47.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
11552025-07-01T19:43:47.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
11562025-07-01T19:43:47.081ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
11572025-07-01T19:43:47.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11582025-07-01T19:43:47.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11592025-07-01T19:43:47.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11602025-07-01T19:43:48.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
11612025-07-01T19:43:48.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
11622025-07-01T19:43:48.081ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
11632025-07-01T19:43:48.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11642025-07-01T19:43:48.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11652025-07-01T19:43:48.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11662025-07-01T19:43:49.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
11672025-07-01T19:43:49.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
11682025-07-01T19:43:49.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
11692025-07-01T19:43:49.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11702025-07-01T19:43:49.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11712025-07-01T19:43:49.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11722025-07-01T19:43:49.921ZDEBGoximeter (results-sink): inserting 90 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
11732025-07-01T19:43:49.921ZDEBGoximeter (results-sink-cluster): inserting 90 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
11742025-07-01T19:43:49.921ZDEBGoximeter (clickhouse-client): unrolling 90 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
11752025-07-01T19:43:49.921ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
11762025-07-01T19:43:49.924ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:43:49.921982075Z } timeseries_name = static_routing_config:static_routes
11772025-07-01T19:43:49.925ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
11782025-07-01T19:43:49.927ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:43:49.924997161Z } timeseries_name = static_routing_config:static_nexthops
11792025-07-01T19:43:49.927ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
11802025-07-01T19:43:49.929ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:43:49.927174279Z } timeseries_name = switch_rib:active_routes
11812025-07-01T19:43:49.929ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
11822025-07-01T19:43:49.931ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-07-01T19:43:49.929295127Z } timeseries_name = mg_lower:routes_blocked_by_link_state
11832025-07-01T19:43:49.934ZDEBGoximeter (clickhouse-client): inserting 4 new timeseries schema collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
11842025-07-01T19:43:49.937ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 30 table_name = fields_string
11852025-07-01T19:43:49.938ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 36 table_name = fields_uuid
11862025-07-01T19:43:49.940ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 60 table_name = measurements_cumulativeu64
11872025-07-01T19:43:49.941ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 30 table_name = measurements_u64
11882025-07-01T19:43:50.023ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
11892025-07-01T19:43:50.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
11902025-07-01T19:43:50.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
11912025-07-01T19:43:50.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
11922025-07-01T19:43:50.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11932025-07-01T19:43:50.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11942025-07-01T19:43:50.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11952025-07-01T19:43:51.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
11962025-07-01T19:43:51.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
11972025-07-01T19:43:51.081ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
11982025-07-01T19:43:51.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
11992025-07-01T19:43:51.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12002025-07-01T19:43:51.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12012025-07-01T19:43:52.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12022025-07-01T19:43:52.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12032025-07-01T19:43:52.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12042025-07-01T19:43:52.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12052025-07-01T19:43:52.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12062025-07-01T19:43:52.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12072025-07-01T19:43:53.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12082025-07-01T19:43:53.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12092025-07-01T19:43:53.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12102025-07-01T19:43:53.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12112025-07-01T19:43:53.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12122025-07-01T19:43:53.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12132025-07-01T19:43:54.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
12142025-07-01T19:43:54.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
12152025-07-01T19:43:54.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12162025-07-01T19:43:54.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12172025-07-01T19:43:54.081ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12182025-07-01T19:43:54.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
12192025-07-01T19:43:54.083ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 4d3e94c8-ba98-4758-88a5-d77f8f70d343
12202025-07-01T19:43:54.083ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 4d3e94c8-ba98-4758-88a5-d77f8f70d343
12212025-07-01T19:43:54.084ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
12222025-07-01T19:43:54.084ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
12232025-07-01T19:43:54.084ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
12242025-07-01T19:43:54.084ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
12252025-07-01T19:43:54.085ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
12262025-07-01T19:43:54.091ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 4d3e94c8-ba98-4758-88a5-d77f8f70d343
12272025-07-01T19:43:54.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
12282025-07-01T19:43:54.100ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
12292025-07-01T19:43:54.100ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
12302025-07-01T19:43:54.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 25dc216c-284d-4191-af96-58995bf80f21
12312025-07-01T19:43:54.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12322025-07-01T19:43:54.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12332025-07-01T19:43:54.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12342025-07-01T19:43:54.922ZDEBGoximeter (results-sink): inserting 237 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
12352025-07-01T19:43:54.922ZDEBGoximeter (results-sink-cluster): inserting 237 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
12362025-07-01T19:43:54.922ZDEBGoximeter (clickhouse-client): unrolling 237 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
12372025-07-01T19:43:54.935ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 212 table_name = fields_i16
12382025-07-01T19:43:54.937ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 673 table_name = fields_string
12392025-07-01T19:43:54.938ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 147 table_name = fields_u16
12402025-07-01T19:43:54.939ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 113 table_name = fields_u32
12412025-07-01T19:43:54.941ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 112 table_name = fields_u8
12422025-07-01T19:43:54.942ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 395 table_name = fields_uuid
12432025-07-01T19:43:54.943ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 6 table_name = measurements_bool
12442025-07-01T19:43:54.945ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 137 table_name = measurements_cumulativeu64
12452025-07-01T19:43:54.946ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 1 table_name = measurements_f64
12462025-07-01T19:43:54.948ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 41 table_name = measurements_histogramu64
12472025-07-01T19:43:54.950ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 52 table_name = measurements_u64
12482025-07-01T19:43:55.023ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
12492025-07-01T19:43:55.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12502025-07-01T19:43:55.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12512025-07-01T19:43:55.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12522025-07-01T19:43:55.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12532025-07-01T19:43:55.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12542025-07-01T19:43:55.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12552025-07-01T19:43:56.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12562025-07-01T19:43:56.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12572025-07-01T19:43:56.081ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12582025-07-01T19:43:56.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12592025-07-01T19:43:56.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12602025-07-01T19:43:56.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12612025-07-01T19:43:57.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12622025-07-01T19:43:57.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12632025-07-01T19:43:57.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12642025-07-01T19:43:57.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12652025-07-01T19:43:57.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12662025-07-01T19:43:57.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12672025-07-01T19:43:58.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12682025-07-01T19:43:58.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12692025-07-01T19:43:58.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12702025-07-01T19:43:58.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12712025-07-01T19:43:58.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12722025-07-01T19:43:58.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12732025-07-01T19:43:59.074ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
12742025-07-01T19:43:59.074ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending
12752025-07-01T19:43:59.077ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "83d9a3d9-ef54-4361-bcda-d56809b96875", "content-length": "1276", "date": "Tue, 01 Jul 2025 19:43:58 GMT"} })
12762025-07-01T19:43:59.077ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D
12772025-07-01T19:43:59.080ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad2fc36d-7be2-4c29-afa2-cb465ec72103", "content-length": "29", "date": "Tue, 01 Jul 2025 19:43:58 GMT"} })
12782025-07-01T19:43:59.080ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:637 n_current_tasks = 8 n_pruned_tasks = 0
12792025-07-01T19:43:59.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12802025-07-01T19:43:59.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12812025-07-01T19:43:59.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12822025-07-01T19:43:59.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12832025-07-01T19:43:59.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12842025-07-01T19:43:59.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12852025-07-01T19:43:59.922ZDEBGoximeter (results-sink): inserting 90 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
12862025-07-01T19:43:59.922ZDEBGoximeter (results-sink-cluster): inserting 90 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
12872025-07-01T19:43:59.922ZDEBGoximeter (clickhouse-client): unrolling 90 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
12882025-07-01T19:43:59.927ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 30 table_name = fields_string
12892025-07-01T19:43:59.929ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 36 table_name = fields_uuid
12902025-07-01T19:43:59.930ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 60 table_name = measurements_cumulativeu64
12912025-07-01T19:43:59.932ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 30 table_name = measurements_u64
12922025-07-01T19:44:00.023ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
12932025-07-01T19:44:00.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12942025-07-01T19:44:00.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12952025-07-01T19:44:00.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
12962025-07-01T19:44:00.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12972025-07-01T19:44:00.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12982025-07-01T19:44:00.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
12992025-07-01T19:44:01.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13002025-07-01T19:44:01.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13012025-07-01T19:44:01.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13022025-07-01T19:44:01.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13032025-07-01T19:44:01.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13042025-07-01T19:44:01.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13052025-07-01T19:44:02.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13062025-07-01T19:44:02.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13072025-07-01T19:44:02.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13082025-07-01T19:44:02.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13092025-07-01T19:44:02.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13102025-07-01T19:44:02.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13112025-07-01T19:44:03.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13122025-07-01T19:44:03.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13132025-07-01T19:44:03.081ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13142025-07-01T19:44:03.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13152025-07-01T19:44:03.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13162025-07-01T19:44:03.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13172025-07-01T19:44:04.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
13182025-07-01T19:44:04.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
13192025-07-01T19:44:04.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13202025-07-01T19:44:04.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13212025-07-01T19:44:04.081ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13222025-07-01T19:44:04.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
13232025-07-01T19:44:04.083ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 4d3e94c8-ba98-4758-88a5-d77f8f70d343
13242025-07-01T19:44:04.083ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 4d3e94c8-ba98-4758-88a5-d77f8f70d343
13252025-07-01T19:44:04.084ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 4d3e94c8-ba98-4758-88a5-d77f8f70d343
13262025-07-01T19:44:04.084ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
13272025-07-01T19:44:04.085ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
13282025-07-01T19:44:04.085ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
13292025-07-01T19:44:04.085ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
13302025-07-01T19:44:04.085ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
13312025-07-01T19:44:04.093ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
13322025-07-01T19:44:04.100ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
13332025-07-01T19:44:04.100ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
13342025-07-01T19:44:04.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 25dc216c-284d-4191-af96-58995bf80f21
13352025-07-01T19:44:04.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13362025-07-01T19:44:04.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13372025-07-01T19:44:04.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13382025-07-01T19:44:04.922ZDEBGoximeter (results-sink): inserting 237 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
13392025-07-01T19:44:04.922ZDEBGoximeter (results-sink-cluster): inserting 237 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
13402025-07-01T19:44:04.922ZDEBGoximeter (clickhouse-client): unrolling 237 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
13412025-07-01T19:44:04.935ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 212 table_name = fields_i16
13422025-07-01T19:44:04.937ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 673 table_name = fields_string
13432025-07-01T19:44:04.938ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 147 table_name = fields_u16
13442025-07-01T19:44:04.939ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 113 table_name = fields_u32
13452025-07-01T19:44:04.941ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 112 table_name = fields_u8
13462025-07-01T19:44:04.942ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 395 table_name = fields_uuid
13472025-07-01T19:44:04.943ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 6 table_name = measurements_bool
13482025-07-01T19:44:04.945ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 137 table_name = measurements_cumulativeu64
13492025-07-01T19:44:04.946ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 1 table_name = measurements_f64
13502025-07-01T19:44:04.948ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 41 table_name = measurements_histogramu64
13512025-07-01T19:44:04.949ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 52 table_name = measurements_u64
13522025-07-01T19:44:05.022ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
13532025-07-01T19:44:05.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13542025-07-01T19:44:05.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13552025-07-01T19:44:05.081ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13562025-07-01T19:44:05.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13572025-07-01T19:44:05.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13582025-07-01T19:44:05.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13592025-07-01T19:44:06.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13602025-07-01T19:44:06.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13612025-07-01T19:44:06.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13622025-07-01T19:44:06.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13632025-07-01T19:44:06.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13642025-07-01T19:44:06.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13652025-07-01T19:44:07.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13662025-07-01T19:44:07.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13672025-07-01T19:44:07.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13682025-07-01T19:44:07.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13692025-07-01T19:44:07.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13702025-07-01T19:44:07.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13712025-07-01T19:44:08.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13722025-07-01T19:44:08.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13732025-07-01T19:44:08.081ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13742025-07-01T19:44:08.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13752025-07-01T19:44:08.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13762025-07-01T19:44:08.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13772025-07-01T19:44:09.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13782025-07-01T19:44:09.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13792025-07-01T19:44:09.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13802025-07-01T19:44:09.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13812025-07-01T19:44:09.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13822025-07-01T19:44:09.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13832025-07-01T19:44:09.922ZDEBGoximeter (results-sink): inserting 90 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
13842025-07-01T19:44:09.922ZDEBGoximeter (results-sink-cluster): inserting 90 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
13852025-07-01T19:44:09.922ZDEBGoximeter (clickhouse-client): unrolling 90 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
13862025-07-01T19:44:09.927ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 30 table_name = fields_string
13872025-07-01T19:44:09.929ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 36 table_name = fields_uuid
13882025-07-01T19:44:09.930ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 60 table_name = measurements_cumulativeu64
13892025-07-01T19:44:09.931ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 30 table_name = measurements_u64
13902025-07-01T19:44:10.022ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
13912025-07-01T19:44:10.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13922025-07-01T19:44:10.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13932025-07-01T19:44:10.081ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13942025-07-01T19:44:10.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13952025-07-01T19:44:10.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13962025-07-01T19:44:10.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
13972025-07-01T19:44:11.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13982025-07-01T19:44:11.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
13992025-07-01T19:44:11.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
14002025-07-01T19:44:11.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
14012025-07-01T19:44:11.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
14022025-07-01T19:44:11.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
14032025-07-01T19:44:12.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
14042025-07-01T19:44:12.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
14052025-07-01T19:44:12.081ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
14062025-07-01T19:44:12.104ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
14072025-07-01T19:44:12.104ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
14082025-07-01T19:44:12.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
14092025-07-01T19:44:13.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
14102025-07-01T19:44:13.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
14112025-07-01T19:44:13.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
14122025-07-01T19:44:13.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
14132025-07-01T19:44:13.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
14142025-07-01T19:44:13.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
14152025-07-01T19:44:14.074ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
14162025-07-01T19:44:14.074ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending
14172025-07-01T19:44:14.077ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e2c44fb-dce8-4de4-8fa5-147f2dea312c", "content-length": "1412", "date": "Tue, 01 Jul 2025 19:44:14 GMT"} })
14182025-07-01T19:44:14.077ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D
14192025-07-01T19:44:14.079ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b6e4f23-5da9-4d34-9733-cadf70571462", "content-length": "29", "date": "Tue, 01 Jul 2025 19:44:13 GMT"} })
14202025-07-01T19:44:14.079ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
14212025-07-01T19:44:14.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
14222025-07-01T19:44:14.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
14232025-07-01T19:44:14.081ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:637 n_current_tasks = 9 n_pruned_tasks = 0
14242025-07-01T19:44:14.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
14252025-07-01T19:44:14.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
14262025-07-01T19:44:14.081ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
14272025-07-01T19:44:14.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
14282025-07-01T19:44:14.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
14292025-07-01T19:44:14.083ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = e11276c4-5a36-4c10-8407-432ae47cf5cf
14302025-07-01T19:44:14.083ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = e11276c4-5a36-4c10-8407-432ae47cf5cf
14312025-07-01T19:44:14.083ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 4d3e94c8-ba98-4758-88a5-d77f8f70d343
14322025-07-01T19:44:14.083ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 4d3e94c8-ba98-4758-88a5-d77f8f70d343
14332025-07-01T19:44:14.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = e11276c4-5a36-4c10-8407-432ae47cf5cf
14342025-07-01T19:44:14.084ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = e11276c4-5a36-4c10-8407-432ae47cf5cf
14352025-07-01T19:44:14.084ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 4d3e94c8-ba98-4758-88a5-d77f8f70d343
14362025-07-01T19:44:14.085ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
14372025-07-01T19:44:14.085ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
14382025-07-01T19:44:14.085ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
14392025-07-01T19:44:14.085ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
14402025-07-01T19:44:14.086ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
14412025-07-01T19:44:14.086ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
14422025-07-01T19:44:14.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
14432025-07-01T19:44:14.100ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
14442025-07-01T19:44:14.100ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
14452025-07-01T19:44:14.101ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
14462025-07-01T19:44:14.103ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
14472025-07-01T19:44:14.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 25dc216c-284d-4191-af96-58995bf80f21
14482025-07-01T19:44:14.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
14492025-07-01T19:44:14.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
14502025-07-01T19:44:14.106ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
14512025-07-01T19:44:14.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
14522025-07-01T19:44:14.923ZDEBGoximeter (results-sink): inserting 243 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
14532025-07-01T19:44:14.923ZDEBGoximeter (results-sink-cluster): inserting 243 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
14542025-07-01T19:44:14.923ZDEBGoximeter (clickhouse-client): unrolling 243 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
14552025-07-01T19:44:14.936ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 212 table_name = fields_i16
14562025-07-01T19:44:14.937ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 12 table_name = fields_ipaddr
14572025-07-01T19:44:14.939ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 679 table_name = fields_string
14582025-07-01T19:44:14.940ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 159 table_name = fields_u16
14592025-07-01T19:44:14.942ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 113 table_name = fields_u32
14602025-07-01T19:44:14.943ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 112 table_name = fields_u8
14612025-07-01T19:44:14.945ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 407 table_name = fields_uuid
14622025-07-01T19:44:14.947ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 6 table_name = measurements_bool
14632025-07-01T19:44:14.948ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 143 table_name = measurements_cumulativeu64
14642025-07-01T19:44:14.949ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 1 table_name = measurements_f64
14652025-07-01T19:44:14.952ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 41 table_name = measurements_histogramu64
14662025-07-01T19:44:14.953ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 52 table_name = measurements_u64
14672025-07-01T19:44:15.024ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
14682025-07-01T19:44:15.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
14692025-07-01T19:44:15.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
14702025-07-01T19:44:15.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
14712025-07-01T19:44:15.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
14722025-07-01T19:44:15.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
14732025-07-01T19:44:15.087ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
14742025-07-01T19:44:15.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
14752025-07-01T19:44:15.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
14762025-07-01T19:44:15.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
14772025-07-01T19:44:16.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
14782025-07-01T19:44:16.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
14792025-07-01T19:44:16.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
14802025-07-01T19:44:16.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
14812025-07-01T19:44:16.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
14822025-07-01T19:44:16.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
14832025-07-01T19:44:16.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
14842025-07-01T19:44:16.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
14852025-07-01T19:44:16.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
14862025-07-01T19:44:17.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
14872025-07-01T19:44:17.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
14882025-07-01T19:44:17.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
14892025-07-01T19:44:17.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
14902025-07-01T19:44:17.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
14912025-07-01T19:44:17.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
14922025-07-01T19:44:17.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
14932025-07-01T19:44:17.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
14942025-07-01T19:44:17.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
14952025-07-01T19:44:18.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
14962025-07-01T19:44:18.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
14972025-07-01T19:44:18.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
14982025-07-01T19:44:18.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
14992025-07-01T19:44:18.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
15002025-07-01T19:44:18.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
15012025-07-01T19:44:18.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
15022025-07-01T19:44:18.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
15032025-07-01T19:44:18.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
15042025-07-01T19:44:19.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
15052025-07-01T19:44:19.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
15062025-07-01T19:44:19.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
15072025-07-01T19:44:19.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
15082025-07-01T19:44:19.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
15092025-07-01T19:44:19.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
15102025-07-01T19:44:19.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
15112025-07-01T19:44:19.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
15122025-07-01T19:44:19.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
15132025-07-01T19:44:19.922ZDEBGoximeter (results-sink): inserting 220 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
15142025-07-01T19:44:19.922ZDEBGoximeter (results-sink-cluster): inserting 220 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
15152025-07-01T19:44:19.922ZDEBGoximeter (clickhouse-client): unrolling 220 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
15162025-07-01T19:44:19.932ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 56 table_name = fields_string
15172025-07-01T19:44:19.934ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 64 table_name = fields_uuid
15182025-07-01T19:44:19.935ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 160 table_name = measurements_cumulativeu64
15192025-07-01T19:44:19.936ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 60 table_name = measurements_u64
15202025-07-01T19:44:20.024ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
15212025-07-01T19:44:20.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
15222025-07-01T19:44:20.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
15232025-07-01T19:44:20.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
15242025-07-01T19:44:20.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
15252025-07-01T19:44:20.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
15262025-07-01T19:44:20.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
15272025-07-01T19:44:20.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
15282025-07-01T19:44:20.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
15292025-07-01T19:44:20.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
15302025-07-01T19:44:21.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
15312025-07-01T19:44:21.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
15322025-07-01T19:44:21.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
15332025-07-01T19:44:21.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
15342025-07-01T19:44:21.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
15352025-07-01T19:44:21.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
15362025-07-01T19:44:21.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
15372025-07-01T19:44:21.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
15382025-07-01T19:44:21.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
15392025-07-01T19:44:22.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
15402025-07-01T19:44:22.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
15412025-07-01T19:44:22.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
15422025-07-01T19:44:22.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
15432025-07-01T19:44:22.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
15442025-07-01T19:44:22.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
15452025-07-01T19:44:22.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
15462025-07-01T19:44:22.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
15472025-07-01T19:44:22.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
15482025-07-01T19:44:23.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
15492025-07-01T19:44:23.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
15502025-07-01T19:44:23.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
15512025-07-01T19:44:23.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
15522025-07-01T19:44:23.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
15532025-07-01T19:44:23.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
15542025-07-01T19:44:23.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
15552025-07-01T19:44:23.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
15562025-07-01T19:44:23.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
15572025-07-01T19:44:24.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
15582025-07-01T19:44:24.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
15592025-07-01T19:44:24.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
15602025-07-01T19:44:24.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
15612025-07-01T19:44:24.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
15622025-07-01T19:44:24.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
15632025-07-01T19:44:24.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
15642025-07-01T19:44:24.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
15652025-07-01T19:44:24.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
15662025-07-01T19:44:24.084ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 4d3e94c8-ba98-4758-88a5-d77f8f70d343
15672025-07-01T19:44:24.084ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 4d3e94c8-ba98-4758-88a5-d77f8f70d343
15682025-07-01T19:44:24.086ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
15692025-07-01T19:44:24.086ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
15702025-07-01T19:44:24.086ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
15712025-07-01T19:44:24.086ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
15722025-07-01T19:44:24.086ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 4d3e94c8-ba98-4758-88a5-d77f8f70d343
15732025-07-01T19:44:24.086ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
15742025-07-01T19:44:24.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
15752025-07-01T19:44:24.100ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
15762025-07-01T19:44:24.100ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
15772025-07-01T19:44:24.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 25dc216c-284d-4191-af96-58995bf80f21
15782025-07-01T19:44:24.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
15792025-07-01T19:44:24.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
15802025-07-01T19:44:24.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
15812025-07-01T19:44:24.922ZDEBGoximeter (results-sink): inserting 367 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
15822025-07-01T19:44:24.922ZDEBGoximeter (results-sink-cluster): inserting 367 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
15832025-07-01T19:44:24.922ZDEBGoximeter (clickhouse-client): unrolling 367 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
15842025-07-01T19:44:24.941ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 212 table_name = fields_i16
15852025-07-01T19:44:24.942ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 699 table_name = fields_string
15862025-07-01T19:44:24.944ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 147 table_name = fields_u16
15872025-07-01T19:44:24.945ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 113 table_name = fields_u32
15882025-07-01T19:44:24.947ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 112 table_name = fields_u8
15892025-07-01T19:44:24.948ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 423 table_name = fields_uuid
15902025-07-01T19:44:24.949ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 6 table_name = measurements_bool
15912025-07-01T19:44:24.951ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 237 table_name = measurements_cumulativeu64
15922025-07-01T19:44:24.952ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 1 table_name = measurements_f64
15932025-07-01T19:44:24.954ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 41 table_name = measurements_histogramu64
15942025-07-01T19:44:24.955ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 82 table_name = measurements_u64
15952025-07-01T19:44:25.024ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
15962025-07-01T19:44:25.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
15972025-07-01T19:44:25.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
15982025-07-01T19:44:25.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
15992025-07-01T19:44:25.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16002025-07-01T19:44:25.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16012025-07-01T19:44:25.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16022025-07-01T19:44:25.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16032025-07-01T19:44:25.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16042025-07-01T19:44:25.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16052025-07-01T19:44:26.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16062025-07-01T19:44:26.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16072025-07-01T19:44:26.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16082025-07-01T19:44:26.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16092025-07-01T19:44:26.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16102025-07-01T19:44:26.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16112025-07-01T19:44:26.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16122025-07-01T19:44:26.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16132025-07-01T19:44:26.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16142025-07-01T19:44:27.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16152025-07-01T19:44:27.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16162025-07-01T19:44:27.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16172025-07-01T19:44:27.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16182025-07-01T19:44:27.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16192025-07-01T19:44:27.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16202025-07-01T19:44:27.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16212025-07-01T19:44:27.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16222025-07-01T19:44:27.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16232025-07-01T19:44:28.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16242025-07-01T19:44:28.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16252025-07-01T19:44:28.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16262025-07-01T19:44:28.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16272025-07-01T19:44:28.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16282025-07-01T19:44:28.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16292025-07-01T19:44:28.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16302025-07-01T19:44:28.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16312025-07-01T19:44:28.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16322025-07-01T19:44:29.074ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
16332025-07-01T19:44:29.074ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending
16342025-07-01T19:44:29.078ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "154097a4-7939-41f4-bb7c-f0070fd414c1", "content-length": "1412", "date": "Tue, 01 Jul 2025 19:44:29 GMT"} })
16352025-07-01T19:44:29.078ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D
16362025-07-01T19:44:29.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16372025-07-01T19:44:29.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16382025-07-01T19:44:29.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16392025-07-01T19:44:29.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16402025-07-01T19:44:29.081ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "46d46dbe-b06d-408f-87a2-b50a01838d69", "content-length": "29", "date": "Tue, 01 Jul 2025 19:44:29 GMT"} })
16412025-07-01T19:44:29.081ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:637 n_current_tasks = 9 n_pruned_tasks = 0
16422025-07-01T19:44:29.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16432025-07-01T19:44:29.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16442025-07-01T19:44:29.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16452025-07-01T19:44:29.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16462025-07-01T19:44:29.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16472025-07-01T19:44:29.922ZDEBGoximeter (results-sink): inserting 220 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
16482025-07-01T19:44:29.922ZDEBGoximeter (results-sink-cluster): inserting 220 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
16492025-07-01T19:44:29.922ZDEBGoximeter (clickhouse-client): unrolling 220 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
16502025-07-01T19:44:29.932ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 56 table_name = fields_string
16512025-07-01T19:44:29.934ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 64 table_name = fields_uuid
16522025-07-01T19:44:29.935ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 160 table_name = measurements_cumulativeu64
16532025-07-01T19:44:29.937ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 60 table_name = measurements_u64
16542025-07-01T19:44:30.023ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
16552025-07-01T19:44:30.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16562025-07-01T19:44:30.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16572025-07-01T19:44:30.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16582025-07-01T19:44:30.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16592025-07-01T19:44:30.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16602025-07-01T19:44:30.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16612025-07-01T19:44:30.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16622025-07-01T19:44:30.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16632025-07-01T19:44:30.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16642025-07-01T19:44:31.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16652025-07-01T19:44:31.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16662025-07-01T19:44:31.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16672025-07-01T19:44:31.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16682025-07-01T19:44:31.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16692025-07-01T19:44:31.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16702025-07-01T19:44:31.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16712025-07-01T19:44:31.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16722025-07-01T19:44:31.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16732025-07-01T19:44:32.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16742025-07-01T19:44:32.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16752025-07-01T19:44:32.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16762025-07-01T19:44:32.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16772025-07-01T19:44:32.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16782025-07-01T19:44:32.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16792025-07-01T19:44:32.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16802025-07-01T19:44:32.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16812025-07-01T19:44:32.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16822025-07-01T19:44:33.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16832025-07-01T19:44:33.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16842025-07-01T19:44:33.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16852025-07-01T19:44:33.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16862025-07-01T19:44:33.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16872025-07-01T19:44:33.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16882025-07-01T19:44:33.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16892025-07-01T19:44:33.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16902025-07-01T19:44:33.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
16912025-07-01T19:44:34.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16922025-07-01T19:44:34.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16932025-07-01T19:44:34.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
16942025-07-01T19:44:34.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16952025-07-01T19:44:34.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16962025-07-01T19:44:34.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
16972025-07-01T19:44:34.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
16982025-07-01T19:44:34.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
16992025-07-01T19:44:34.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
17002025-07-01T19:44:34.084ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 4d3e94c8-ba98-4758-88a5-d77f8f70d343
17012025-07-01T19:44:34.084ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 4d3e94c8-ba98-4758-88a5-d77f8f70d343
17022025-07-01T19:44:34.085ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 4d3e94c8-ba98-4758-88a5-d77f8f70d343
17032025-07-01T19:44:34.085ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
17042025-07-01T19:44:34.085ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
17052025-07-01T19:44:34.085ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
17062025-07-01T19:44:34.085ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
17072025-07-01T19:44:34.086ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
17082025-07-01T19:44:34.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
17092025-07-01T19:44:34.100ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
17102025-07-01T19:44:34.100ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
17112025-07-01T19:44:34.103ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 25dc216c-284d-4191-af96-58995bf80f21
17122025-07-01T19:44:34.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
17132025-07-01T19:44:34.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
17142025-07-01T19:44:34.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
17152025-07-01T19:44:34.922ZDEBGoximeter (results-sink): inserting 367 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
17162025-07-01T19:44:34.922ZDEBGoximeter (results-sink-cluster): inserting 367 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
17172025-07-01T19:44:34.922ZDEBGoximeter (clickhouse-client): unrolling 367 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
17182025-07-01T19:44:34.940ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 212 table_name = fields_i16
17192025-07-01T19:44:34.942ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 699 table_name = fields_string
17202025-07-01T19:44:34.943ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 147 table_name = fields_u16
17212025-07-01T19:44:34.945ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 113 table_name = fields_u32
17222025-07-01T19:44:34.946ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 112 table_name = fields_u8
17232025-07-01T19:44:34.948ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 423 table_name = fields_uuid
17242025-07-01T19:44:34.949ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 6 table_name = measurements_bool
17252025-07-01T19:44:34.950ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 237 table_name = measurements_cumulativeu64
17262025-07-01T19:44:34.951ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 1 table_name = measurements_f64
17272025-07-01T19:44:34.954ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 41 table_name = measurements_histogramu64
17282025-07-01T19:44:34.955ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 82 table_name = measurements_u64
17292025-07-01T19:44:35.023ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
17302025-07-01T19:44:35.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
17312025-07-01T19:44:35.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
17322025-07-01T19:44:35.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
17332025-07-01T19:44:35.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
17342025-07-01T19:44:35.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
17352025-07-01T19:44:35.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
17362025-07-01T19:44:35.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
17372025-07-01T19:44:35.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
17382025-07-01T19:44:35.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
17392025-07-01T19:44:36.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
17402025-07-01T19:44:36.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
17412025-07-01T19:44:36.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
17422025-07-01T19:44:36.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
17432025-07-01T19:44:36.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
17442025-07-01T19:44:36.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
17452025-07-01T19:44:36.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
17462025-07-01T19:44:36.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
17472025-07-01T19:44:36.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
17482025-07-01T19:44:37.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
17492025-07-01T19:44:37.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
17502025-07-01T19:44:37.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
17512025-07-01T19:44:37.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
17522025-07-01T19:44:37.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
17532025-07-01T19:44:37.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
17542025-07-01T19:44:37.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
17552025-07-01T19:44:37.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
17562025-07-01T19:44:37.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
17572025-07-01T19:44:38.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
17582025-07-01T19:44:38.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
17592025-07-01T19:44:38.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
17602025-07-01T19:44:38.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
17612025-07-01T19:44:38.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
17622025-07-01T19:44:38.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
17632025-07-01T19:44:38.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
17642025-07-01T19:44:38.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
17652025-07-01T19:44:38.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
17662025-07-01T19:44:39.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
17672025-07-01T19:44:39.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
17682025-07-01T19:44:39.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
17692025-07-01T19:44:39.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
17702025-07-01T19:44:39.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
17712025-07-01T19:44:39.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
17722025-07-01T19:44:39.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
17732025-07-01T19:44:39.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
17742025-07-01T19:44:39.106ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
17752025-07-01T19:44:39.922ZDEBGoximeter (results-sink): inserting 220 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
17762025-07-01T19:44:39.922ZDEBGoximeter (results-sink-cluster): inserting 220 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
17772025-07-01T19:44:39.922ZDEBGoximeter (clickhouse-client): unrolling 220 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
17782025-07-01T19:44:39.932ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 56 table_name = fields_string
17792025-07-01T19:44:39.934ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 64 table_name = fields_uuid
17802025-07-01T19:44:39.935ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 160 table_name = measurements_cumulativeu64
17812025-07-01T19:44:39.937ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 60 table_name = measurements_u64
17822025-07-01T19:44:40.023ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
17832025-07-01T19:44:40.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
17842025-07-01T19:44:40.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
17852025-07-01T19:44:40.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
17862025-07-01T19:44:40.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
17872025-07-01T19:44:40.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
17882025-07-01T19:44:40.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
17892025-07-01T19:44:40.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
17902025-07-01T19:44:40.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
17912025-07-01T19:44:40.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
17922025-07-01T19:44:41.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
17932025-07-01T19:44:41.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
17942025-07-01T19:44:41.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
17952025-07-01T19:44:41.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
17962025-07-01T19:44:41.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
17972025-07-01T19:44:41.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
17982025-07-01T19:44:41.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
17992025-07-01T19:44:41.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
18002025-07-01T19:44:41.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
18012025-07-01T19:44:42.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
18022025-07-01T19:44:42.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
18032025-07-01T19:44:42.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
18042025-07-01T19:44:42.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
18052025-07-01T19:44:42.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
18062025-07-01T19:44:42.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
18072025-07-01T19:44:42.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
18082025-07-01T19:44:42.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
18092025-07-01T19:44:42.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
18102025-07-01T19:44:43.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
18112025-07-01T19:44:43.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
18122025-07-01T19:44:43.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
18132025-07-01T19:44:43.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
18142025-07-01T19:44:43.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
18152025-07-01T19:44:43.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
18162025-07-01T19:44:43.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
18172025-07-01T19:44:43.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
18182025-07-01T19:44:43.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
18192025-07-01T19:44:44.074ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
18202025-07-01T19:44:44.074ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending
18212025-07-01T19:44:44.078ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca87f584-d7aa-484d-aa63-09718d01356a", "content-length": "1412", "date": "Tue, 01 Jul 2025 19:44:43 GMT"} })
18222025-07-01T19:44:44.078ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D
18232025-07-01T19:44:44.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
18242025-07-01T19:44:44.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
18252025-07-01T19:44:44.080ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "49f6d7dd-1892-470a-96d7-d4bdee2fb767", "content-length": "29", "date": "Tue, 01 Jul 2025 19:44:44 GMT"} })
18262025-07-01T19:44:44.080ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:637 n_current_tasks = 9 n_pruned_tasks = 0
18272025-07-01T19:44:44.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
18282025-07-01T19:44:44.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
18292025-07-01T19:44:44.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
18302025-07-01T19:44:44.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
18312025-07-01T19:44:44.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
18322025-07-01T19:44:44.082ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
18332025-07-01T19:44:44.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
18342025-07-01T19:44:44.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
18352025-07-01T19:44:44.083ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = e11276c4-5a36-4c10-8407-432ae47cf5cf
18362025-07-01T19:44:44.083ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 4d3e94c8-ba98-4758-88a5-d77f8f70d343
18372025-07-01T19:44:44.083ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = e11276c4-5a36-4c10-8407-432ae47cf5cf
18382025-07-01T19:44:44.083ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 4d3e94c8-ba98-4758-88a5-d77f8f70d343
18392025-07-01T19:44:44.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = e11276c4-5a36-4c10-8407-432ae47cf5cf
18402025-07-01T19:44:44.084ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 4d3e94c8-ba98-4758-88a5-d77f8f70d343
18412025-07-01T19:44:44.085ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 4d3e94c8-ba98-4758-88a5-d77f8f70d343
18422025-07-01T19:44:44.086ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
18432025-07-01T19:44:44.086ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
18442025-07-01T19:44:44.086ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
18452025-07-01T19:44:44.086ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
18462025-07-01T19:44:44.086ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
18472025-07-01T19:44:44.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
18482025-07-01T19:44:44.101ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
18492025-07-01T19:44:44.101ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
18502025-07-01T19:44:44.104ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 25dc216c-284d-4191-af96-58995bf80f21
18512025-07-01T19:44:44.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
18522025-07-01T19:44:44.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
18532025-07-01T19:44:44.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
18542025-07-01T19:44:44.922ZDEBGoximeter (results-sink): inserting 369 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
18552025-07-01T19:44:44.922ZDEBGoximeter (results-sink-cluster): inserting 369 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
18562025-07-01T19:44:44.922ZDEBGoximeter (clickhouse-client): unrolling 369 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
18572025-07-01T19:44:44.939ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 212 table_name = fields_i16
18582025-07-01T19:44:44.941ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 4 table_name = fields_ipaddr
18592025-07-01T19:44:44.942ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 701 table_name = fields_string
18602025-07-01T19:44:44.944ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 151 table_name = fields_u16
18612025-07-01T19:44:44.945ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 113 table_name = fields_u32
18622025-07-01T19:44:44.947ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 112 table_name = fields_u8
18632025-07-01T19:44:44.948ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 427 table_name = fields_uuid
18642025-07-01T19:44:44.949ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 6 table_name = measurements_bool
18652025-07-01T19:44:44.951ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 239 table_name = measurements_cumulativeu64
18662025-07-01T19:44:44.952ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 1 table_name = measurements_f64
18672025-07-01T19:44:44.954ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 41 table_name = measurements_histogramu64
18682025-07-01T19:44:44.956ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 82 table_name = measurements_u64
18692025-07-01T19:44:45.024ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
18702025-07-01T19:44:45.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
18712025-07-01T19:44:45.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
18722025-07-01T19:44:45.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
18732025-07-01T19:44:45.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
18742025-07-01T19:44:45.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
18752025-07-01T19:44:45.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
18762025-07-01T19:44:45.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
18772025-07-01T19:44:45.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
18782025-07-01T19:44:45.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
18792025-07-01T19:44:46.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
18802025-07-01T19:44:46.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
18812025-07-01T19:44:46.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
18822025-07-01T19:44:46.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
18832025-07-01T19:44:46.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
18842025-07-01T19:44:46.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
18852025-07-01T19:44:46.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
18862025-07-01T19:44:46.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
18872025-07-01T19:44:46.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
18882025-07-01T19:44:47.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
18892025-07-01T19:44:47.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
18902025-07-01T19:44:47.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
18912025-07-01T19:44:47.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
18922025-07-01T19:44:47.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
18932025-07-01T19:44:47.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
18942025-07-01T19:44:47.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
18952025-07-01T19:44:47.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
18962025-07-01T19:44:47.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
18972025-07-01T19:44:48.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
18982025-07-01T19:44:48.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
18992025-07-01T19:44:48.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
19002025-07-01T19:44:48.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
19012025-07-01T19:44:48.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
19022025-07-01T19:44:48.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
19032025-07-01T19:44:48.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
19042025-07-01T19:44:48.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
19052025-07-01T19:44:48.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
19062025-07-01T19:44:49.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
19072025-07-01T19:44:49.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
19082025-07-01T19:44:49.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
19092025-07-01T19:44:49.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
19102025-07-01T19:44:49.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
19112025-07-01T19:44:49.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
19122025-07-01T19:44:49.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
19132025-07-01T19:44:49.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
19142025-07-01T19:44:49.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
19152025-07-01T19:44:49.922ZDEBGoximeter (results-sink): inserting 220 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
19162025-07-01T19:44:49.922ZDEBGoximeter (results-sink-cluster): inserting 220 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
19172025-07-01T19:44:49.922ZDEBGoximeter (clickhouse-client): unrolling 220 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
19182025-07-01T19:44:49.932ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 56 table_name = fields_string
19192025-07-01T19:44:49.934ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 64 table_name = fields_uuid
19202025-07-01T19:44:49.935ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 160 table_name = measurements_cumulativeu64
19212025-07-01T19:44:49.937ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 60 table_name = measurements_u64
19222025-07-01T19:44:50.024ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
19232025-07-01T19:44:50.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
19242025-07-01T19:44:50.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
19252025-07-01T19:44:50.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
19262025-07-01T19:44:50.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
19272025-07-01T19:44:50.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
19282025-07-01T19:44:50.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
19292025-07-01T19:44:50.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
19302025-07-01T19:44:50.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
19312025-07-01T19:44:50.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
19322025-07-01T19:44:51.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
19332025-07-01T19:44:51.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
19342025-07-01T19:44:51.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
19352025-07-01T19:44:51.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
19362025-07-01T19:44:51.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
19372025-07-01T19:44:51.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
19382025-07-01T19:44:51.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
19392025-07-01T19:44:51.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
19402025-07-01T19:44:51.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
19412025-07-01T19:44:52.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
19422025-07-01T19:44:52.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
19432025-07-01T19:44:52.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
19442025-07-01T19:44:52.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
19452025-07-01T19:44:52.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
19462025-07-01T19:44:52.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
19472025-07-01T19:44:52.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
19482025-07-01T19:44:52.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
19492025-07-01T19:44:52.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
19502025-07-01T19:44:53.080ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
19512025-07-01T19:44:53.080ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
19522025-07-01T19:44:53.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
19532025-07-01T19:44:53.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
19542025-07-01T19:44:53.082ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
19552025-07-01T19:44:53.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
19562025-07-01T19:44:53.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
19572025-07-01T19:44:53.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
19582025-07-01T19:44:53.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
19592025-07-01T19:44:54.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
19602025-07-01T19:44:54.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
19612025-07-01T19:44:54.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
19622025-07-01T19:44:54.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
19632025-07-01T19:44:54.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
19642025-07-01T19:44:54.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
19652025-07-01T19:44:54.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
19662025-07-01T19:44:54.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = d2039cd7-e36b-4625-9259-c2a97e8d1832
19672025-07-01T19:44:54.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
19682025-07-01T19:44:54.084ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 4d3e94c8-ba98-4758-88a5-d77f8f70d343
19692025-07-01T19:44:54.084ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 4d3e94c8-ba98-4758-88a5-d77f8f70d343
19702025-07-01T19:44:54.085ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 4d3e94c8-ba98-4758-88a5-d77f8f70d343
19712025-07-01T19:44:54.086ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
19722025-07-01T19:44:54.086ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
19732025-07-01T19:44:54.086ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
19742025-07-01T19:44:54.086ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
19752025-07-01T19:44:54.086ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = ef9e8259-ba17-45c0-8576-4e186f4e4ac5
19762025-07-01T19:44:54.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b0177fd6-2fd2-4040-9b0d-38c4f08584ec
19772025-07-01T19:44:54.101ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
19782025-07-01T19:44:54.101ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 25dc216c-284d-4191-af96-58995bf80f21
19792025-07-01T19:44:54.105ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 25dc216c-284d-4191-af96-58995bf80f21
19802025-07-01T19:44:54.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
19812025-07-01T19:44:54.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
19822025-07-01T19:44:54.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
19832025-07-01T19:44:54.922ZDEBGoximeter (results-sink): inserting 367 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
19842025-07-01T19:44:54.923ZDEBGoximeter (results-sink-cluster): inserting 367 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
19852025-07-01T19:44:54.923ZDEBGoximeter (clickhouse-client): unrolling 367 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
19862025-07-01T19:44:54.939ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 212 table_name = fields_i16
19872025-07-01T19:44:54.941ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 699 table_name = fields_string
19882025-07-01T19:44:54.942ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 147 table_name = fields_u16
19892025-07-01T19:44:54.944ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 113 table_name = fields_u32
19902025-07-01T19:44:54.945ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 112 table_name = fields_u8
19912025-07-01T19:44:54.947ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 423 table_name = fields_uuid
19922025-07-01T19:44:54.948ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 6 table_name = measurements_bool
19932025-07-01T19:44:54.949ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 237 table_name = measurements_cumulativeu64
19942025-07-01T19:44:54.951ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 1 table_name = measurements_f64
19952025-07-01T19:44:54.953ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 41 table_name = measurements_histogramu64
19962025-07-01T19:44:54.954ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 82 table_name = measurements_u64
19972025-07-01T19:44:55.024ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
19982025-07-01T19:44:55.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
19992025-07-01T19:44:55.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
20002025-07-01T19:44:55.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20012025-07-01T19:44:55.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20022025-07-01T19:44:55.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20032025-07-01T19:44:55.084ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
20042025-07-01T19:44:55.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
20052025-07-01T19:44:55.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
20062025-07-01T19:44:55.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
20072025-07-01T19:44:56.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
20082025-07-01T19:44:56.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
20092025-07-01T19:44:56.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20102025-07-01T19:44:56.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20112025-07-01T19:44:56.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20122025-07-01T19:44:56.084ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
20132025-07-01T19:44:56.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
20142025-07-01T19:44:56.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
20152025-07-01T19:44:56.108ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
20162025-07-01T19:44:57.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
20172025-07-01T19:44:57.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
20182025-07-01T19:44:57.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20192025-07-01T19:44:57.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20202025-07-01T19:44:57.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20212025-07-01T19:44:57.084ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
20222025-07-01T19:44:57.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
20232025-07-01T19:44:57.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
20242025-07-01T19:44:57.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
20252025-07-01T19:44:58.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
20262025-07-01T19:44:58.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
20272025-07-01T19:44:58.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20282025-07-01T19:44:58.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20292025-07-01T19:44:58.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20302025-07-01T19:44:58.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
20312025-07-01T19:44:58.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
20322025-07-01T19:44:58.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
20332025-07-01T19:44:58.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
20342025-07-01T19:44:59.075ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
20352025-07-01T19:44:59.075ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending
20362025-07-01T19:44:59.079ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "9dc9a3de-f658-4c17-a8c9-81f2bb2562e0", "content-length": "1412", "date": "Tue, 01 Jul 2025 19:44:58 GMT"} })
20372025-07-01T19:44:59.079ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D
20382025-07-01T19:44:59.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
20392025-07-01T19:44:59.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
20402025-07-01T19:44:59.081ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/7e98d451-495f-44e2-be17-0c1e3ae1019c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZjllODI1OS1iYTE3LTQ1YzAtODU3Ni00ZTE4NmY0ZTRhYzUifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "60bd32e4-5c62-4ccf-88cc-5fa68c7dcd4d", "content-length": "29", "date": "Tue, 01 Jul 2025 19:44:59 GMT"} })
20412025-07-01T19:44:59.081ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:637 n_current_tasks = 9 n_pruned_tasks = 0
20422025-07-01T19:44:59.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20432025-07-01T19:44:59.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20442025-07-01T19:44:59.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20452025-07-01T19:44:59.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
20462025-07-01T19:44:59.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
20472025-07-01T19:44:59.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
20482025-07-01T19:44:59.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
20492025-07-01T19:44:59.923ZDEBGoximeter (results-sink): inserting 220 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
20502025-07-01T19:44:59.923ZDEBGoximeter (results-sink-cluster): inserting 220 samples into database collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d
20512025-07-01T19:44:59.923ZDEBGoximeter (clickhouse-client): unrolling 220 total samples collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094
20522025-07-01T19:44:59.932ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 56 table_name = fields_string
20532025-07-01T19:44:59.934ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 64 table_name = fields_uuid
20542025-07-01T19:44:59.935ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 160 table_name = measurements_cumulativeu64
20552025-07-01T19:44:59.937ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d id = 23a407dc-4fb3-4a10-9e91-a7ffa0ac7094 n_rows = 60 table_name = measurements_u64
20562025-07-01T19:45:00.024ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
20572025-07-01T19:45:00.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
20582025-07-01T19:45:00.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
20592025-07-01T19:45:00.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20602025-07-01T19:45:00.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20612025-07-01T19:45:00.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20622025-07-01T19:45:00.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
20632025-07-01T19:45:00.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
20642025-07-01T19:45:00.105ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
20652025-07-01T19:45:00.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
20662025-07-01T19:45:01.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
20672025-07-01T19:45:01.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
20682025-07-01T19:45:01.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20692025-07-01T19:45:01.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20702025-07-01T19:45:01.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20712025-07-01T19:45:01.084ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
20722025-07-01T19:45:01.105ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
20732025-07-01T19:45:01.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
20742025-07-01T19:45:01.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
20752025-07-01T19:45:02.081ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
20762025-07-01T19:45:02.081ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
20772025-07-01T19:45:02.082ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20782025-07-01T19:45:02.082ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20792025-07-01T19:45:02.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 1b68be35-8b40-4c21-9d1b-96e6730b93c2
20802025-07-01T19:45:02.083ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = b1d637a9-aea3-4ebb-a53d-9fe2258cf750
20812025-07-01T19:45:02.106ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
20822025-07-01T19:45:02.106ZDEBGoximeter (collection-task): collecting from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd
20832025-07-01T19:45:02.107ZDEBGoximeter (collection-task): collected results from producer collector_id = 7e98d451-495f-44e2-be17-0c1e3ae1019c collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = d834c1b1-b04e-4dd5-8e88-ec8aa0e294bd