Max level shown:
1 [ Mar 25 22:28:19 Enabled. ]
2 [ Mar 25 22:28:19 Rereading configuration. ]
3 [ Mar 25 22:28:21 Rereading configuration. ]
4 [ Mar 25 22:28:26 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id 26728504-e36d-4baa-856d-cd0ce7a172a2 &"). ]
5 [ Mar 25 22:28:26 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72025-03-25T22:28:26.971ZDEBGoximeter: registered DTrace probes
82025-03-25T22:28:26.974ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:236
92025-03-25T22:28:26.975ZDEBGoximeter: creating ClickHouse client
102025-03-25T22:28:26.991ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
112025-03-25T22:28:29.236ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:894 id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
122025-03-25T22:28:29.237ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
132025-03-25T22:28:29.237ZINFOoximeter (clickhouse-client): reading db version collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:794 id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
142025-03-25T22:28:29.238ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:894 id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
152025-03-25T22:28:29.238ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:799 id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 version = 0
162025-03-25T22:28:29.238ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:804 id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
172025-03-25T22:28:29.238ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
182025-03-25T22:28:29.802ZINFOoximeter (clickhouse-client): inserting current version collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:825 id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 version = 14
192025-03-25T22:28:29.823ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = 2649e730-7ce0-46f8-b701-956a243d6bd4
202025-03-25T22:28:29.832ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212025-03-25T22:28:29.832ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222025-03-25T22:28:29.832ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232025-03-25T22:28:29.832ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242025-03-25T22:28:29.832ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::d]:12223
252025-03-25T22:28:29.832ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262025-03-25T22:28:29.832ZDEBGoximeter: registered USDT probes
272025-03-25T22:28:29.832ZDEBGoximeter: contacting nexus
282025-03-25T22:28:29.963ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
292025-03-25T22:28:29.967ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
302025-03-25T22:28:29.968ZWARNoximeter: failed to contact nexus, will retry in 142.526089ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:374
312025-03-25T22:28:30.112ZDEBGoximeter: contacting nexus
322025-03-25T22:28:30.112ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
332025-03-25T22:28:30.112ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
342025-03-25T22:28:30.112ZWARNoximeter: failed to contact nexus, will retry in 738.937345ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:374
352025-03-25T22:28:30.851ZDEBGoximeter: contacting nexus
362025-03-25T22:28:30.851ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
372025-03-25T22:28:31.076ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "9df2c1da-5c3f-4afa-82f2-d664e52b6566", "date": "Tue, 25 Mar 2025 22:28:30 GMT"} })
382025-03-25T22:28:31.078ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:392 id = 26728504-e36d-4baa-856d-cd0ce7a172a2
392025-03-25T22:28:31.078ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:559
402025-03-25T22:28:31.079ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
412025-03-25T22:28:31.082ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?sort_by=id_ascending
422025-03-25T22:28:31.082ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?sort_by=id_ascending", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
432025-03-25T22:28:31.082ZERROoximeter (oximeter-agent): error fetching next assigned producer, abandoning this refresh attempt collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?sort_by=id_ascending): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?sort_by=id_ascending): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = oximeter/collector/src/agent.rs:600
442025-03-25T22:28:46.078ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
452025-03-25T22:28:46.078ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?sort_by=id_ascending
462025-03-25T22:28:46.083ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ec64569-79a1-4f7d-bf6b-c5bab1c14fbd", "content-length": "998", "date": "Tue, 25 Mar 2025 22:28:46 GMT"} })
472025-03-25T22:28:46.085ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmN2FjMTAxNy0zNmU3LTQwZWMtOTE3Mi1lNGUxNTQ1ZTczYzgifX0%3D
482025-03-25T22:28:46.088ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmN2FjMTAxNy0zNmU3LTQwZWMtOTE3Mi1lNGUxNTQ1ZTczYzgifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8ba4d72-4ecb-43cd-9367-eef643599cd6", "content-length": "29", "date": "Tue, 25 Mar 2025 22:28:46 GMT"} })
492025-03-25T22:28:46.088ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:43158 collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 090a0cc9-0d65-46af-9930-34d91d91522e
502025-03-25T22:28:46.090ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
512025-03-25T22:28:46.093ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
522025-03-25T22:28:46.095ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
532025-03-25T22:28:46.097ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:51659 collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 7d404169-4ae6-4cdb-9762-83a2feb6083c
542025-03-25T22:28:46.099ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:48399 collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = f7ac1017-36e7-40ec-9172-e4e1545e73c8
552025-03-25T22:28:46.101ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:637 n_current_tasks = 6 n_pruned_tasks = 0
562025-03-25T22:28:47.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
572025-03-25T22:28:47.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
582025-03-25T22:28:47.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
592025-03-25T22:28:47.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
602025-03-25T22:28:47.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
612025-03-25T22:28:47.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
622025-03-25T22:28:47.113ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
632025-03-25T22:28:47.113ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
642025-03-25T22:28:47.114ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
652025-03-25T22:28:48.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
662025-03-25T22:28:48.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
672025-03-25T22:28:48.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
682025-03-25T22:28:48.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
692025-03-25T22:28:48.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
702025-03-25T22:28:48.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
712025-03-25T22:28:48.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
722025-03-25T22:28:48.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
732025-03-25T22:28:48.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
742025-03-25T22:28:49.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
752025-03-25T22:28:49.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
762025-03-25T22:28:49.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
772025-03-25T22:28:49.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
782025-03-25T22:28:49.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
792025-03-25T22:28:49.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
802025-03-25T22:28:49.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
812025-03-25T22:28:49.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
822025-03-25T22:28:49.097ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
832025-03-25T22:28:49.824ZDEBGoximeter (results-sink-cluster): inserting 132 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
842025-03-25T22:28:49.824ZDEBGoximeter (results-sink): inserting 132 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
852025-03-25T22:28:49.824ZDEBGoximeter (clickhouse-client): unrolling 132 total samples collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
862025-03-25T22:28:49.829ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
872025-03-25T22:28:49.841ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:28:49.829307054Z } timeseries_name = static_routing_config:static_routes
882025-03-25T22:28:49.845ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
892025-03-25T22:28:49.852ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:28:49.845324016Z } timeseries_name = static_routing_config:static_nexthops
902025-03-25T22:28:49.852ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
912025-03-25T22:28:49.853ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:28:49.852447006Z } timeseries_name = switch_rib:active_routes
922025-03-25T22:28:49.853ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
932025-03-25T22:28:49.854ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:28:49.853682489Z } timeseries_name = mg_lower:routes_blocked_by_link_state
942025-03-25T22:28:49.854ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
952025-03-25T22:28:49.856ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:28:49.854861660Z } timeseries_name = ddm_router:originated_underlay_prefixes
962025-03-25T22:28:49.856ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
972025-03-25T22:28:49.857ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:28:49.856213895Z } timeseries_name = ddm_router:originated_tunnel_endpoints
982025-03-25T22:28:49.857ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
992025-03-25T22:28:49.858ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:28:49.857455677Z } timeseries_name = ddm_session:solicitations_sent
1002025-03-25T22:28:49.858ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
1012025-03-25T22:28:49.859ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:28:49.858679910Z } timeseries_name = ddm_session:solicitations_received
1022025-03-25T22:28:49.859ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
1032025-03-25T22:28:49.861ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:28:49.859930423Z } timeseries_name = ddm_session:advertisements_sent
1042025-03-25T22:28:49.861ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
1052025-03-25T22:28:49.862ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:28:49.861171455Z } timeseries_name = ddm_session:advertisements_received
1062025-03-25T22:28:49.862ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
1072025-03-25T22:28:49.863ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:28:49.862408768Z } timeseries_name = ddm_session:peer_expirations
1082025-03-25T22:28:49.863ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
1092025-03-25T22:28:49.864ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:28:49.863649560Z } timeseries_name = ddm_session:peer_address_changes
1102025-03-25T22:28:49.865ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
1112025-03-25T22:28:49.866ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:28:49.865005955Z } timeseries_name = ddm_session:peer_sessions_established
1122025-03-25T22:28:49.866ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
1132025-03-25T22:28:49.867ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:28:49.866277158Z } timeseries_name = ddm_session:updates_sent
1142025-03-25T22:28:49.867ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
1152025-03-25T22:28:49.868ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:28:49.867559131Z } timeseries_name = ddm_session:updates_received
1162025-03-25T22:28:49.868ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
1172025-03-25T22:28:49.870ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:28:49.868838965Z } timeseries_name = ddm_session:update_send_fail
1182025-03-25T22:28:49.870ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
1192025-03-25T22:28:49.871ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:28:49.870173609Z } timeseries_name = ddm_session:imported_underlay_prefixes
1202025-03-25T22:28:49.871ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
1212025-03-25T22:28:49.872ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:28:49.871548894Z } timeseries_name = ddm_session:imported_tunnel_endpoints
1222025-03-25T22:28:49.877ZDEBGoximeter (clickhouse-client): inserting 18 new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
1232025-03-25T22:28:49.891ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 56 table_name = fields_string
1242025-03-25T22:28:49.893ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 64 table_name = fields_uuid
1252025-03-25T22:28:49.898ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 96 table_name = measurements_cumulativeu64
1262025-03-25T22:28:49.900ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 36 table_name = measurements_u64
1272025-03-25T22:28:49.925ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
1282025-03-25T22:28:50.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
1292025-03-25T22:28:50.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
1302025-03-25T22:28:50.093ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
1312025-03-25T22:28:50.093ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
1322025-03-25T22:28:50.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
1332025-03-25T22:28:50.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
1342025-03-25T22:28:50.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
1352025-03-25T22:28:50.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
1362025-03-25T22:28:50.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
1372025-03-25T22:28:51.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
1382025-03-25T22:28:51.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
1392025-03-25T22:28:51.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
1402025-03-25T22:28:51.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
1412025-03-25T22:28:51.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
1422025-03-25T22:28:51.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
1432025-03-25T22:28:51.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
1442025-03-25T22:28:51.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
1452025-03-25T22:28:51.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
1462025-03-25T22:28:52.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
1472025-03-25T22:28:52.091ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
1482025-03-25T22:28:52.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
1492025-03-25T22:28:52.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
1502025-03-25T22:28:52.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
1512025-03-25T22:28:52.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
1522025-03-25T22:28:52.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
1532025-03-25T22:28:52.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
1542025-03-25T22:28:52.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
1552025-03-25T22:28:53.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
1562025-03-25T22:28:53.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
1572025-03-25T22:28:53.093ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
1582025-03-25T22:28:53.093ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
1592025-03-25T22:28:53.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
1602025-03-25T22:28:53.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
1612025-03-25T22:28:53.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
1622025-03-25T22:28:53.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
1632025-03-25T22:28:53.097ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
1642025-03-25T22:28:54.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
1652025-03-25T22:28:54.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
1662025-03-25T22:28:54.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
1672025-03-25T22:28:54.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
1682025-03-25T22:28:54.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
1692025-03-25T22:28:54.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
1702025-03-25T22:28:54.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
1712025-03-25T22:28:54.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
1722025-03-25T22:28:54.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
1732025-03-25T22:28:54.824ZDEBGoximeter (results-sink-cluster): inserting 220 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
1742025-03-25T22:28:54.824ZDEBGoximeter (results-sink): inserting 220 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
1752025-03-25T22:28:54.824ZDEBGoximeter (clickhouse-client): unrolling 220 total samples collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
1762025-03-25T22:28:54.834ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 56 table_name = fields_string
1772025-03-25T22:28:54.836ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 64 table_name = fields_uuid
1782025-03-25T22:28:54.838ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 160 table_name = measurements_cumulativeu64
1792025-03-25T22:28:54.839ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 60 table_name = measurements_u64
1802025-03-25T22:28:54.926ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
1812025-03-25T22:28:55.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
1822025-03-25T22:28:55.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
1832025-03-25T22:28:55.093ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
1842025-03-25T22:28:55.093ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
1852025-03-25T22:28:55.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
1862025-03-25T22:28:55.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
1872025-03-25T22:28:55.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
1882025-03-25T22:28:55.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
1892025-03-25T22:28:55.097ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
1902025-03-25T22:28:56.089ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 090a0cc9-0d65-46af-9930-34d91d91522e
1912025-03-25T22:28:56.089ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 090a0cc9-0d65-46af-9930-34d91d91522e
1922025-03-25T22:28:56.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
1932025-03-25T22:28:56.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
1942025-03-25T22:28:56.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
1952025-03-25T22:28:56.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
1962025-03-25T22:28:56.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
1972025-03-25T22:28:56.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
1982025-03-25T22:28:56.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
1992025-03-25T22:28:56.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2002025-03-25T22:28:56.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2012025-03-25T22:28:56.097ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 090a0cc9-0d65-46af-9930-34d91d91522e
2022025-03-25T22:28:57.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2032025-03-25T22:28:57.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2042025-03-25T22:28:57.093ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2052025-03-25T22:28:57.093ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2062025-03-25T22:28:57.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2072025-03-25T22:28:57.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2082025-03-25T22:28:57.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2092025-03-25T22:28:57.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2102025-03-25T22:28:57.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2112025-03-25T22:28:58.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2122025-03-25T22:28:58.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2132025-03-25T22:28:58.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2142025-03-25T22:28:58.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2152025-03-25T22:28:58.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2162025-03-25T22:28:58.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2172025-03-25T22:28:58.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2182025-03-25T22:28:58.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2192025-03-25T22:28:58.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2202025-03-25T22:28:59.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2212025-03-25T22:28:59.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2222025-03-25T22:28:59.093ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2232025-03-25T22:28:59.093ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2242025-03-25T22:28:59.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2252025-03-25T22:28:59.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2262025-03-25T22:28:59.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2272025-03-25T22:28:59.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2282025-03-25T22:28:59.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2292025-03-25T22:28:59.824ZDEBGoximeter (results-sink-cluster): inserting 228 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
2302025-03-25T22:28:59.824ZDEBGoximeter (results-sink): inserting 228 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
2312025-03-25T22:28:59.824ZDEBGoximeter (clickhouse-client): unrolling 228 total samples collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
2322025-03-25T22:28:59.828ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
2332025-03-25T22:28:59.847ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:28:59.828122172Z } timeseries_name = http_service:request_latency_histogram
2342025-03-25T22:28:59.852ZDEBGoximeter (clickhouse-client): inserting 1 new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
2352025-03-25T22:28:59.856ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 72 table_name = fields_string
2362025-03-25T22:28:59.858ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 8 table_name = fields_u16
2372025-03-25T22:28:59.860ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 72 table_name = fields_uuid
2382025-03-25T22:28:59.861ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 160 table_name = measurements_cumulativeu64
2392025-03-25T22:28:59.868ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 8 table_name = measurements_histogramu64
2402025-03-25T22:28:59.870ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 60 table_name = measurements_u64
2412025-03-25T22:28:59.925ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
2422025-03-25T22:29:00.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2432025-03-25T22:29:00.091ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2442025-03-25T22:29:00.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2452025-03-25T22:29:00.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2462025-03-25T22:29:00.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2472025-03-25T22:29:00.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2482025-03-25T22:29:00.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2492025-03-25T22:29:00.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2502025-03-25T22:29:00.097ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2512025-03-25T22:29:01.077ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
2522025-03-25T22:29:01.077ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?sort_by=id_ascending
2532025-03-25T22:29:01.083ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "31430ac1-9e99-4586-a331-662c48ebd18c", "content-length": "998", "date": "Tue, 25 Mar 2025 22:29:01 GMT"} })
2542025-03-25T22:29:01.083ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmN2FjMTAxNy0zNmU3LTQwZWMtOTE3Mi1lNGUxNTQ1ZTczYzgifX0%3D
2552025-03-25T22:29:01.086ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmN2FjMTAxNy0zNmU3LTQwZWMtOTE3Mi1lNGUxNTQ1ZTczYzgifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6593671-19e5-4f15-908f-933bc3182d97", "content-length": "29", "date": "Tue, 25 Mar 2025 22:29:01 GMT"} })
2562025-03-25T22:29:01.086ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:637 n_current_tasks = 6 n_pruned_tasks = 0
2572025-03-25T22:29:01.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2582025-03-25T22:29:01.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2592025-03-25T22:29:01.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2602025-03-25T22:29:01.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2612025-03-25T22:29:01.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2622025-03-25T22:29:01.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2632025-03-25T22:29:01.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2642025-03-25T22:29:01.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2652025-03-25T22:29:01.097ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2662025-03-25T22:29:02.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2672025-03-25T22:29:02.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2682025-03-25T22:29:02.093ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2692025-03-25T22:29:02.093ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2702025-03-25T22:29:02.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2712025-03-25T22:29:02.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2722025-03-25T22:29:02.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2732025-03-25T22:29:02.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2742025-03-25T22:29:02.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2752025-03-25T22:29:03.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2762025-03-25T22:29:03.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2772025-03-25T22:29:03.093ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2782025-03-25T22:29:03.093ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2792025-03-25T22:29:03.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2802025-03-25T22:29:03.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2812025-03-25T22:29:03.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2822025-03-25T22:29:03.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2832025-03-25T22:29:03.097ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2842025-03-25T22:29:04.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2852025-03-25T22:29:04.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2862025-03-25T22:29:04.093ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2872025-03-25T22:29:04.093ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2882025-03-25T22:29:04.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
2892025-03-25T22:29:04.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
2902025-03-25T22:29:04.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2912025-03-25T22:29:04.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2922025-03-25T22:29:04.097ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
2932025-03-25T22:29:04.824ZDEBGoximeter (results-sink-cluster): inserting 220 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
2942025-03-25T22:29:04.824ZDEBGoximeter (results-sink): inserting 220 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
2952025-03-25T22:29:04.824ZDEBGoximeter (clickhouse-client): unrolling 220 total samples collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
2962025-03-25T22:29:04.836ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 56 table_name = fields_string
2972025-03-25T22:29:04.838ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 64 table_name = fields_uuid
2982025-03-25T22:29:04.840ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 160 table_name = measurements_cumulativeu64
2992025-03-25T22:29:04.842ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 60 table_name = measurements_u64
3002025-03-25T22:29:04.925ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
3012025-03-25T22:29:05.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3022025-03-25T22:29:05.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3032025-03-25T22:29:05.093ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3042025-03-25T22:29:05.093ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3052025-03-25T22:29:05.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3062025-03-25T22:29:05.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3072025-03-25T22:29:05.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3082025-03-25T22:29:05.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3092025-03-25T22:29:05.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3102025-03-25T22:29:06.090ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 090a0cc9-0d65-46af-9930-34d91d91522e
3112025-03-25T22:29:06.090ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 090a0cc9-0d65-46af-9930-34d91d91522e
3122025-03-25T22:29:06.092ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 090a0cc9-0d65-46af-9930-34d91d91522e
3132025-03-25T22:29:06.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3142025-03-25T22:29:06.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3152025-03-25T22:29:06.093ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3162025-03-25T22:29:06.093ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3172025-03-25T22:29:06.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3182025-03-25T22:29:06.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3192025-03-25T22:29:06.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3202025-03-25T22:29:06.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3212025-03-25T22:29:06.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3222025-03-25T22:29:07.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3232025-03-25T22:29:07.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3242025-03-25T22:29:07.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3252025-03-25T22:29:07.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3262025-03-25T22:29:07.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3272025-03-25T22:29:07.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3282025-03-25T22:29:07.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3292025-03-25T22:29:07.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3302025-03-25T22:29:07.097ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3312025-03-25T22:29:08.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3322025-03-25T22:29:08.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3332025-03-25T22:29:08.093ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3342025-03-25T22:29:08.093ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3352025-03-25T22:29:08.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3362025-03-25T22:29:08.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3372025-03-25T22:29:08.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3382025-03-25T22:29:08.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3392025-03-25T22:29:08.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3402025-03-25T22:29:09.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3412025-03-25T22:29:09.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3422025-03-25T22:29:09.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3432025-03-25T22:29:09.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3442025-03-25T22:29:09.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3452025-03-25T22:29:09.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3462025-03-25T22:29:09.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3472025-03-25T22:29:09.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3482025-03-25T22:29:09.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3492025-03-25T22:29:09.824ZDEBGoximeter (results-sink-cluster): inserting 228 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
3502025-03-25T22:29:09.824ZDEBGoximeter (results-sink): inserting 228 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
3512025-03-25T22:29:09.824ZDEBGoximeter (clickhouse-client): unrolling 228 total samples collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
3522025-03-25T22:29:09.835ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 72 table_name = fields_string
3532025-03-25T22:29:09.836ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 8 table_name = fields_u16
3542025-03-25T22:29:09.838ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 72 table_name = fields_uuid
3552025-03-25T22:29:09.840ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 160 table_name = measurements_cumulativeu64
3562025-03-25T22:29:09.843ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 8 table_name = measurements_histogramu64
3572025-03-25T22:29:09.844ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 60 table_name = measurements_u64
3582025-03-25T22:29:09.924ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
3592025-03-25T22:29:10.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3602025-03-25T22:29:10.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3612025-03-25T22:29:10.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3622025-03-25T22:29:10.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3632025-03-25T22:29:10.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3642025-03-25T22:29:10.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3652025-03-25T22:29:10.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3662025-03-25T22:29:10.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3672025-03-25T22:29:10.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3682025-03-25T22:29:11.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3692025-03-25T22:29:11.091ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3702025-03-25T22:29:11.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3712025-03-25T22:29:11.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3722025-03-25T22:29:11.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3732025-03-25T22:29:11.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3742025-03-25T22:29:11.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3752025-03-25T22:29:11.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3762025-03-25T22:29:11.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3772025-03-25T22:29:12.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3782025-03-25T22:29:12.091ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3792025-03-25T22:29:12.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3802025-03-25T22:29:12.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3812025-03-25T22:29:12.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3822025-03-25T22:29:12.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3832025-03-25T22:29:12.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3842025-03-25T22:29:12.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3852025-03-25T22:29:12.097ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3862025-03-25T22:29:13.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3872025-03-25T22:29:13.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3882025-03-25T22:29:13.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3892025-03-25T22:29:13.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3902025-03-25T22:29:13.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3912025-03-25T22:29:13.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3922025-03-25T22:29:13.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3932025-03-25T22:29:13.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3942025-03-25T22:29:13.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
3952025-03-25T22:29:14.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3962025-03-25T22:29:14.091ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3972025-03-25T22:29:14.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
3982025-03-25T22:29:14.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
3992025-03-25T22:29:14.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
4002025-03-25T22:29:14.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
4012025-03-25T22:29:14.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
4022025-03-25T22:29:14.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
4032025-03-25T22:29:14.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
4042025-03-25T22:29:14.824ZDEBGoximeter (results-sink-cluster): inserting 220 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
4052025-03-25T22:29:14.824ZDEBGoximeter (results-sink): inserting 220 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
4062025-03-25T22:29:14.824ZDEBGoximeter (clickhouse-client): unrolling 220 total samples collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
4072025-03-25T22:29:14.836ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 56 table_name = fields_string
4082025-03-25T22:29:14.843ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 64 table_name = fields_uuid
4092025-03-25T22:29:14.849ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 160 table_name = measurements_cumulativeu64
4102025-03-25T22:29:14.856ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 60 table_name = measurements_u64
4112025-03-25T22:29:14.926ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
4122025-03-25T22:29:15.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
4132025-03-25T22:29:15.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
4142025-03-25T22:29:15.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
4152025-03-25T22:29:15.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
4162025-03-25T22:29:15.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
4172025-03-25T22:29:15.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
4182025-03-25T22:29:15.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
4192025-03-25T22:29:15.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
4202025-03-25T22:29:15.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
4212025-03-25T22:29:16.078ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
4222025-03-25T22:29:16.078ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?sort_by=id_ascending
4232025-03-25T22:29:16.090ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 090a0cc9-0d65-46af-9930-34d91d91522e
4242025-03-25T22:29:16.090ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 090a0cc9-0d65-46af-9930-34d91d91522e
4252025-03-25T22:29:16.092ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 090a0cc9-0d65-46af-9930-34d91d91522e
4262025-03-25T22:29:16.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
4272025-03-25T22:29:16.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
4282025-03-25T22:29:16.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
4292025-03-25T22:29:16.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
4302025-03-25T22:29:16.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
4312025-03-25T22:29:16.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
4322025-03-25T22:29:16.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
4332025-03-25T22:29:16.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
4342025-03-25T22:29:16.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
4352025-03-25T22:29:16.098ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 7d404169-4ae6-4cdb-9762-83a2feb6083c
4362025-03-25T22:29:16.098ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 7d404169-4ae6-4cdb-9762-83a2feb6083c
4372025-03-25T22:29:16.099ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = f7ac1017-36e7-40ec-9172-e4e1545e73c8
4382025-03-25T22:29:16.099ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = f7ac1017-36e7-40ec-9172-e4e1545e73c8
4392025-03-25T22:29:16.106ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e9b239e-38d7-491c-8ce8-1467bfacc283", "content-length": "1136", "date": "Tue, 25 Mar 2025 22:29:16 GMT"} })
4402025-03-25T22:29:16.106ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmN2FjMTAxNy0zNmU3LTQwZWMtOTE3Mi1lNGUxNTQ1ZTczYzgifX0%3D
4412025-03-25T22:29:16.109ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmN2FjMTAxNy0zNmU3LTQwZWMtOTE3Mi1lNGUxNTQ1ZTczYzgifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "1573f25c-e610-4b67-affe-047a1179fc67", "content-length": "29", "date": "Tue, 25 Mar 2025 22:29:16 GMT"} })
4422025-03-25T22:29:16.109ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:46490 collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 22035ab1-4462-404d-8fdb-869e194ecaa9
4432025-03-25T22:29:16.111ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:637 n_current_tasks = 7 n_pruned_tasks = 0
4442025-03-25T22:29:16.120ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7d404169-4ae6-4cdb-9762-83a2feb6083c
4452025-03-25T22:29:16.224ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f7ac1017-36e7-40ec-9172-e4e1545e73c8
4462025-03-25T22:29:16.234ZDEBGoximeter (results-sink-cluster): inserting 2496 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
4472025-03-25T22:29:16.235ZDEBGoximeter (results-sink): inserting 2496 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
4482025-03-25T22:29:16.235ZDEBGoximeter (clickhouse-client): unrolling 2496 total samples collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
4492025-03-25T22:29:16.239ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
4502025-03-25T22:29:16.242ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:29:16.239887410Z } timeseries_name = switch_port_control_data_link:errors_received
4512025-03-25T22:29:16.243ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
4522025-03-25T22:29:16.245ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:29:16.243220321Z } timeseries_name = switch_port_control_data_link:errors_sent
4532025-03-25T22:29:16.245ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
4542025-03-25T22:29:16.247ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:29:16.245575204Z } timeseries_name = switch_port_control_data_link:bytes_received
4552025-03-25T22:29:16.247ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
4562025-03-25T22:29:16.249ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:29:16.247898666Z } timeseries_name = switch_port_control_data_link:packets_received
4572025-03-25T22:29:16.250ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
4582025-03-25T22:29:16.252ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:29:16.250069075Z } timeseries_name = switch_port_control_data_link:bytes_sent
4592025-03-25T22:29:16.252ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
4602025-03-25T22:29:16.254ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:29:16.252302686Z } timeseries_name = switch_port_control_data_link:packets_sent
4612025-03-25T22:29:16.261ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
4622025-03-25T22:29:16.263ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:29:16.261752509Z } timeseries_name = sled_data_link:errors_received
4632025-03-25T22:29:16.264ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
4642025-03-25T22:29:16.266ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:29:16.264074321Z } timeseries_name = sled_data_link:errors_sent
4652025-03-25T22:29:16.266ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
4662025-03-25T22:29:16.268ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:29:16.266189880Z } timeseries_name = sled_data_link:bytes_received
4672025-03-25T22:29:16.268ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
4682025-03-25T22:29:16.270ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:29:16.268265678Z } timeseries_name = sled_data_link:packets_received
4692025-03-25T22:29:16.270ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
4702025-03-25T22:29:16.272ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:29:16.270414837Z } timeseries_name = sled_data_link:bytes_sent
4712025-03-25T22:29:16.272ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
4722025-03-25T22:29:16.274ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:29:16.272538065Z } timeseries_name = sled_data_link:packets_sent
4732025-03-25T22:29:16.336ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
4742025-03-25T22:29:16.367ZDEBGoximeter (clickhouse-client): inserting 12 new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
4752025-03-25T22:29:16.372ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 24 table_name = fields_i16
4762025-03-25T22:29:16.375ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 1332 table_name = fields_string
4772025-03-25T22:29:16.377ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 20 table_name = fields_u16
4782025-03-25T22:29:16.378ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 252 table_name = fields_u32
4792025-03-25T22:29:16.380ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 12 table_name = fields_u8
4802025-03-25T22:29:16.382ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 564 table_name = fields_uuid
4812025-03-25T22:29:16.387ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 2464 table_name = measurements_cumulativeu64
4822025-03-25T22:29:16.390ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 8 table_name = measurements_histogramu64
4832025-03-25T22:29:16.391ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 24 table_name = measurements_u64
4842025-03-25T22:29:17.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
4852025-03-25T22:29:17.091ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
4862025-03-25T22:29:17.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
4872025-03-25T22:29:17.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
4882025-03-25T22:29:17.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
4892025-03-25T22:29:17.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
4902025-03-25T22:29:17.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
4912025-03-25T22:29:17.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
4922025-03-25T22:29:17.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
4932025-03-25T22:29:18.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
4942025-03-25T22:29:18.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
4952025-03-25T22:29:18.093ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
4962025-03-25T22:29:18.093ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
4972025-03-25T22:29:18.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
4982025-03-25T22:29:18.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
4992025-03-25T22:29:18.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5002025-03-25T22:29:18.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5012025-03-25T22:29:18.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5022025-03-25T22:29:19.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5032025-03-25T22:29:19.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5042025-03-25T22:29:19.093ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5052025-03-25T22:29:19.093ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5062025-03-25T22:29:19.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5072025-03-25T22:29:19.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5082025-03-25T22:29:19.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5092025-03-25T22:29:19.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5102025-03-25T22:29:19.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5112025-03-25T22:29:19.823ZDEBGoximeter (results-sink-cluster): inserting 132 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
5122025-03-25T22:29:19.823ZDEBGoximeter (results-sink): inserting 132 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
5132025-03-25T22:29:19.823ZDEBGoximeter (clickhouse-client): unrolling 132 total samples collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
5142025-03-25T22:29:19.831ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 56 table_name = fields_string
5152025-03-25T22:29:19.833ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 64 table_name = fields_uuid
5162025-03-25T22:29:19.834ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 96 table_name = measurements_cumulativeu64
5172025-03-25T22:29:19.836ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 36 table_name = measurements_u64
5182025-03-25T22:29:19.924ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
5192025-03-25T22:29:20.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5202025-03-25T22:29:20.091ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5212025-03-25T22:29:20.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5222025-03-25T22:29:20.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5232025-03-25T22:29:20.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5242025-03-25T22:29:20.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5252025-03-25T22:29:20.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5262025-03-25T22:29:20.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5272025-03-25T22:29:20.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5282025-03-25T22:29:21.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5292025-03-25T22:29:21.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5302025-03-25T22:29:21.093ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5312025-03-25T22:29:21.093ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5322025-03-25T22:29:21.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5332025-03-25T22:29:21.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5342025-03-25T22:29:21.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5352025-03-25T22:29:21.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5362025-03-25T22:29:21.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5372025-03-25T22:29:22.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5382025-03-25T22:29:22.091ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5392025-03-25T22:29:22.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5402025-03-25T22:29:22.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5412025-03-25T22:29:22.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5422025-03-25T22:29:22.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5432025-03-25T22:29:22.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5442025-03-25T22:29:22.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5452025-03-25T22:29:22.097ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5462025-03-25T22:29:23.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5472025-03-25T22:29:23.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5482025-03-25T22:29:23.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5492025-03-25T22:29:23.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5502025-03-25T22:29:23.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5512025-03-25T22:29:23.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5522025-03-25T22:29:23.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5532025-03-25T22:29:23.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5542025-03-25T22:29:23.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5552025-03-25T22:29:24.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5562025-03-25T22:29:24.091ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5572025-03-25T22:29:24.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5582025-03-25T22:29:24.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5592025-03-25T22:29:24.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5602025-03-25T22:29:24.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5612025-03-25T22:29:24.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5622025-03-25T22:29:24.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5632025-03-25T22:29:24.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5642025-03-25T22:29:24.823ZDEBGoximeter (results-sink-cluster): inserting 220 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
5652025-03-25T22:29:24.823ZDEBGoximeter (results-sink): inserting 220 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
5662025-03-25T22:29:24.823ZDEBGoximeter (clickhouse-client): unrolling 220 total samples collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
5672025-03-25T22:29:24.834ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 56 table_name = fields_string
5682025-03-25T22:29:24.836ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 64 table_name = fields_uuid
5692025-03-25T22:29:24.837ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 160 table_name = measurements_cumulativeu64
5702025-03-25T22:29:24.839ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 60 table_name = measurements_u64
5712025-03-25T22:29:24.925ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
5722025-03-25T22:29:25.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5732025-03-25T22:29:25.091ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5742025-03-25T22:29:25.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5752025-03-25T22:29:25.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5762025-03-25T22:29:25.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5772025-03-25T22:29:25.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5782025-03-25T22:29:25.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5792025-03-25T22:29:25.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5802025-03-25T22:29:25.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5812025-03-25T22:29:26.089ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 090a0cc9-0d65-46af-9930-34d91d91522e
5822025-03-25T22:29:26.089ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 090a0cc9-0d65-46af-9930-34d91d91522e
5832025-03-25T22:29:26.091ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 090a0cc9-0d65-46af-9930-34d91d91522e
5842025-03-25T22:29:26.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5852025-03-25T22:29:26.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5862025-03-25T22:29:26.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5872025-03-25T22:29:26.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5882025-03-25T22:29:26.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5892025-03-25T22:29:26.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5902025-03-25T22:29:26.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5912025-03-25T22:29:26.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5922025-03-25T22:29:26.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
5932025-03-25T22:29:26.110ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 22035ab1-4462-404d-8fdb-869e194ecaa9
5942025-03-25T22:29:26.110ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 22035ab1-4462-404d-8fdb-869e194ecaa9
5952025-03-25T22:29:26.122ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 22035ab1-4462-404d-8fdb-869e194ecaa9
5962025-03-25T22:29:27.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5972025-03-25T22:29:27.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
5982025-03-25T22:29:27.093ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
5992025-03-25T22:29:27.093ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
6002025-03-25T22:29:27.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
6012025-03-25T22:29:27.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6022025-03-25T22:29:27.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6032025-03-25T22:29:27.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
6042025-03-25T22:29:27.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6052025-03-25T22:29:28.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
6062025-03-25T22:29:28.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
6072025-03-25T22:29:28.093ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
6082025-03-25T22:29:28.093ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
6092025-03-25T22:29:28.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
6102025-03-25T22:29:28.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
6112025-03-25T22:29:28.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6122025-03-25T22:29:28.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6132025-03-25T22:29:28.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6142025-03-25T22:29:29.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
6152025-03-25T22:29:29.091ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
6162025-03-25T22:29:29.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
6172025-03-25T22:29:29.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
6182025-03-25T22:29:29.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
6192025-03-25T22:29:29.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
6202025-03-25T22:29:29.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6212025-03-25T22:29:29.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6222025-03-25T22:29:29.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6232025-03-25T22:29:29.824ZDEBGoximeter (results-sink-cluster): inserting 272 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
6242025-03-25T22:29:29.824ZDEBGoximeter (results-sink): inserting 272 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
6252025-03-25T22:29:29.824ZDEBGoximeter (clickhouse-client): unrolling 272 total samples collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
6262025-03-25T22:29:29.830ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
6272025-03-25T22:29:29.837ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:29:29.830183310Z } timeseries_name = collection_target:cpus_provisioned
6282025-03-25T22:29:29.837ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
6292025-03-25T22:29:29.840ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:29:29.837544924Z } timeseries_name = collection_target:ram_provisioned
6302025-03-25T22:29:29.840ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
6312025-03-25T22:29:29.843ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:29:29.840338945Z } timeseries_name = collection_target:virtual_disk_space_provisioned
6322025-03-25T22:29:29.848ZDEBGoximeter (clickhouse-client): inserting 3 new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
6332025-03-25T22:29:29.853ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 124 table_name = fields_string
6342025-03-25T22:29:29.854ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 34 table_name = fields_u16
6352025-03-25T22:29:29.857ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 108 table_name = fields_uuid
6362025-03-25T22:29:29.859ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 160 table_name = measurements_cumulativeu64
6372025-03-25T22:29:29.861ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 34 table_name = measurements_histogramu64
6382025-03-25T22:29:29.863ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 18 table_name = measurements_i64
6392025-03-25T22:29:29.865ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 60 table_name = measurements_u64
6402025-03-25T22:29:29.925ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
6412025-03-25T22:29:30.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
6422025-03-25T22:29:30.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
6432025-03-25T22:29:30.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
6442025-03-25T22:29:30.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
6452025-03-25T22:29:30.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
6462025-03-25T22:29:30.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6472025-03-25T22:29:30.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6482025-03-25T22:29:30.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
6492025-03-25T22:29:30.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6502025-03-25T22:29:31.078ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
6512025-03-25T22:29:31.078ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?sort_by=id_ascending
6522025-03-25T22:29:31.080ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "577c9ee5-c257-4fc4-afd8-f5cbb9e07838", "content-length": "1136", "date": "Tue, 25 Mar 2025 22:29:31 GMT"} })
6532025-03-25T22:29:31.081ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmN2FjMTAxNy0zNmU3LTQwZWMtOTE3Mi1lNGUxNTQ1ZTczYzgifX0%3D
6542025-03-25T22:29:31.083ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmN2FjMTAxNy0zNmU3LTQwZWMtOTE3Mi1lNGUxNTQ1ZTczYzgifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c130db1-43a6-4e63-b865-bddfb3919fdb", "content-length": "29", "date": "Tue, 25 Mar 2025 22:29:31 GMT"} })
6552025-03-25T22:29:31.083ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:637 n_current_tasks = 7 n_pruned_tasks = 0
6562025-03-25T22:29:31.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
6572025-03-25T22:29:31.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
6582025-03-25T22:29:31.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
6592025-03-25T22:29:31.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
6602025-03-25T22:29:31.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
6612025-03-25T22:29:31.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
6622025-03-25T22:29:31.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6632025-03-25T22:29:31.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6642025-03-25T22:29:31.097ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6652025-03-25T22:29:32.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
6662025-03-25T22:29:32.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
6672025-03-25T22:29:32.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
6682025-03-25T22:29:32.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
6692025-03-25T22:29:32.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
6702025-03-25T22:29:32.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
6712025-03-25T22:29:32.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6722025-03-25T22:29:32.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6732025-03-25T22:29:32.097ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6742025-03-25T22:29:33.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
6752025-03-25T22:29:33.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
6762025-03-25T22:29:33.093ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
6772025-03-25T22:29:33.093ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
6782025-03-25T22:29:33.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
6792025-03-25T22:29:33.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
6802025-03-25T22:29:33.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6812025-03-25T22:29:33.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6822025-03-25T22:29:33.097ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6832025-03-25T22:29:34.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
6842025-03-25T22:29:34.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
6852025-03-25T22:29:34.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
6862025-03-25T22:29:34.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
6872025-03-25T22:29:34.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
6882025-03-25T22:29:34.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6892025-03-25T22:29:34.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6902025-03-25T22:29:34.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
6912025-03-25T22:29:34.097ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
6922025-03-25T22:29:34.824ZDEBGoximeter (results-sink-cluster): inserting 220 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
6932025-03-25T22:29:34.824ZDEBGoximeter (results-sink): inserting 220 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
6942025-03-25T22:29:34.824ZDEBGoximeter (clickhouse-client): unrolling 220 total samples collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
6952025-03-25T22:29:34.840ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 56 table_name = fields_string
6962025-03-25T22:29:34.846ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 64 table_name = fields_uuid
6972025-03-25T22:29:34.851ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 160 table_name = measurements_cumulativeu64
6982025-03-25T22:29:34.858ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 60 table_name = measurements_u64
6992025-03-25T22:29:34.924ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
7002025-03-25T22:29:35.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7012025-03-25T22:29:35.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7022025-03-25T22:29:35.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7032025-03-25T22:29:35.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7042025-03-25T22:29:35.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7052025-03-25T22:29:35.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7062025-03-25T22:29:35.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7072025-03-25T22:29:35.097ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7082025-03-25T22:29:35.097ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7092025-03-25T22:29:36.090ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 090a0cc9-0d65-46af-9930-34d91d91522e
7102025-03-25T22:29:36.090ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 090a0cc9-0d65-46af-9930-34d91d91522e
7112025-03-25T22:29:36.091ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 090a0cc9-0d65-46af-9930-34d91d91522e
7122025-03-25T22:29:36.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7132025-03-25T22:29:36.091ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7142025-03-25T22:29:36.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7152025-03-25T22:29:36.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7162025-03-25T22:29:36.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7172025-03-25T22:29:36.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7182025-03-25T22:29:36.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7192025-03-25T22:29:36.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7202025-03-25T22:29:36.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7212025-03-25T22:29:36.110ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 22035ab1-4462-404d-8fdb-869e194ecaa9
7222025-03-25T22:29:36.110ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 22035ab1-4462-404d-8fdb-869e194ecaa9
7232025-03-25T22:29:36.114ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 22035ab1-4462-404d-8fdb-869e194ecaa9
7242025-03-25T22:29:37.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7252025-03-25T22:29:37.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7262025-03-25T22:29:37.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7272025-03-25T22:29:37.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7282025-03-25T22:29:37.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7292025-03-25T22:29:37.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7302025-03-25T22:29:37.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7312025-03-25T22:29:37.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7322025-03-25T22:29:37.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7332025-03-25T22:29:38.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7342025-03-25T22:29:38.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7352025-03-25T22:29:38.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7362025-03-25T22:29:38.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7372025-03-25T22:29:38.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7382025-03-25T22:29:38.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7392025-03-25T22:29:38.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7402025-03-25T22:29:38.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7412025-03-25T22:29:38.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7422025-03-25T22:29:39.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7432025-03-25T22:29:39.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7442025-03-25T22:29:39.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7452025-03-25T22:29:39.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7462025-03-25T22:29:39.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7472025-03-25T22:29:39.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7482025-03-25T22:29:39.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7492025-03-25T22:29:39.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7502025-03-25T22:29:39.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7512025-03-25T22:29:39.823ZDEBGoximeter (results-sink-cluster): inserting 254 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
7522025-03-25T22:29:39.823ZDEBGoximeter (results-sink): inserting 254 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
7532025-03-25T22:29:39.823ZDEBGoximeter (clickhouse-client): unrolling 254 total samples collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
7542025-03-25T22:29:39.836ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 124 table_name = fields_string
7552025-03-25T22:29:39.838ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 34 table_name = fields_u16
7562025-03-25T22:29:39.840ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 98 table_name = fields_uuid
7572025-03-25T22:29:39.841ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 160 table_name = measurements_cumulativeu64
7582025-03-25T22:29:39.844ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 34 table_name = measurements_histogramu64
7592025-03-25T22:29:39.846ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 60 table_name = measurements_u64
7602025-03-25T22:29:39.925ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
7612025-03-25T22:29:40.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7622025-03-25T22:29:40.091ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7632025-03-25T22:29:40.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7642025-03-25T22:29:40.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7652025-03-25T22:29:40.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7662025-03-25T22:29:40.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7672025-03-25T22:29:40.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7682025-03-25T22:29:40.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7692025-03-25T22:29:40.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7702025-03-25T22:29:41.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7712025-03-25T22:29:41.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7722025-03-25T22:29:41.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7732025-03-25T22:29:41.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7742025-03-25T22:29:41.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7752025-03-25T22:29:41.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7762025-03-25T22:29:41.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7772025-03-25T22:29:41.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7782025-03-25T22:29:41.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7792025-03-25T22:29:42.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7802025-03-25T22:29:42.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7812025-03-25T22:29:42.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7822025-03-25T22:29:42.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7832025-03-25T22:29:42.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7842025-03-25T22:29:42.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7852025-03-25T22:29:42.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7862025-03-25T22:29:42.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7872025-03-25T22:29:42.097ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7882025-03-25T22:29:43.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7892025-03-25T22:29:43.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7902025-03-25T22:29:43.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7912025-03-25T22:29:43.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7922025-03-25T22:29:43.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7932025-03-25T22:29:43.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
7942025-03-25T22:29:43.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7952025-03-25T22:29:43.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7962025-03-25T22:29:43.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
7972025-03-25T22:29:44.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7982025-03-25T22:29:44.091ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
7992025-03-25T22:29:44.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
8002025-03-25T22:29:44.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
8012025-03-25T22:29:44.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
8022025-03-25T22:29:44.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
8032025-03-25T22:29:44.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
8042025-03-25T22:29:44.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
8052025-03-25T22:29:44.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
8062025-03-25T22:29:44.824ZDEBGoximeter (results-sink-cluster): inserting 220 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
8072025-03-25T22:29:44.824ZDEBGoximeter (results-sink): inserting 220 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
8082025-03-25T22:29:44.824ZDEBGoximeter (clickhouse-client): unrolling 220 total samples collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
8092025-03-25T22:29:44.835ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 56 table_name = fields_string
8102025-03-25T22:29:44.837ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 64 table_name = fields_uuid
8112025-03-25T22:29:44.838ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 160 table_name = measurements_cumulativeu64
8122025-03-25T22:29:44.840ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 60 table_name = measurements_u64
8132025-03-25T22:29:44.926ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
8142025-03-25T22:29:45.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
8152025-03-25T22:29:45.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
8162025-03-25T22:29:45.093ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
8172025-03-25T22:29:45.093ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
8182025-03-25T22:29:45.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
8192025-03-25T22:29:45.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
8202025-03-25T22:29:45.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
8212025-03-25T22:29:45.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
8222025-03-25T22:29:45.097ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
8232025-03-25T22:29:46.078ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
8242025-03-25T22:29:46.078ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?sort_by=id_ascending
8252025-03-25T22:29:46.080ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7de1966-9eeb-416b-a8ab-acdddd086e6f", "content-length": "1412", "date": "Tue, 25 Mar 2025 22:29:45 GMT"} })
8262025-03-25T22:29:46.080ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmN2FjMTAxNy0zNmU3LTQwZWMtOTE3Mi1lNGUxNTQ1ZTczYzgifX0%3D
8272025-03-25T22:29:46.083ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmN2FjMTAxNy0zNmU3LTQwZWMtOTE3Mi1lNGUxNTQ1ZTczYzgifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "85702deb-64ac-47e4-864e-40cada6b52f1", "content-length": "29", "date": "Tue, 25 Mar 2025 22:29:45 GMT"} })
8282025-03-25T22:29:46.083ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:40325 collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 56ee8e9a-ccae-49c2-ac33-94d5159567dd
8292025-03-25T22:29:46.085ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:46633 collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 94680e6f-9c70-48a1-afd3-ee3593739739
8302025-03-25T22:29:46.087ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:637 n_current_tasks = 9 n_pruned_tasks = 0
8312025-03-25T22:29:46.089ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 090a0cc9-0d65-46af-9930-34d91d91522e
8322025-03-25T22:29:46.089ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 090a0cc9-0d65-46af-9930-34d91d91522e
8332025-03-25T22:29:46.091ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 090a0cc9-0d65-46af-9930-34d91d91522e
8342025-03-25T22:29:46.091ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 090a0cc9-0d65-46af-9930-34d91d91522e
8352025-03-25T22:29:46.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
8362025-03-25T22:29:46.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
8372025-03-25T22:29:46.093ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
8382025-03-25T22:29:46.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
8392025-03-25T22:29:46.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
8402025-03-25T22:29:46.094ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
8412025-03-25T22:29:46.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
8422025-03-25T22:29:46.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
8432025-03-25T22:29:46.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
8442025-03-25T22:29:46.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
8452025-03-25T22:29:46.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
8462025-03-25T22:29:46.096ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
8472025-03-25T22:29:46.097ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 7d404169-4ae6-4cdb-9762-83a2feb6083c
8482025-03-25T22:29:46.098ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 7d404169-4ae6-4cdb-9762-83a2feb6083c
8492025-03-25T22:29:46.098ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 7d404169-4ae6-4cdb-9762-83a2feb6083c
8502025-03-25T22:29:46.100ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 7d404169-4ae6-4cdb-9762-83a2feb6083c
8512025-03-25T22:29:46.100ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = f7ac1017-36e7-40ec-9172-e4e1545e73c8
8522025-03-25T22:29:46.100ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = f7ac1017-36e7-40ec-9172-e4e1545e73c8
8532025-03-25T22:29:46.100ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = f7ac1017-36e7-40ec-9172-e4e1545e73c8
8542025-03-25T22:29:46.110ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 22035ab1-4462-404d-8fdb-869e194ecaa9
8552025-03-25T22:29:46.110ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 22035ab1-4462-404d-8fdb-869e194ecaa9
8562025-03-25T22:29:46.113ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 22035ab1-4462-404d-8fdb-869e194ecaa9
8572025-03-25T22:29:46.192ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = f7ac1017-36e7-40ec-9172-e4e1545e73c8
8582025-03-25T22:29:46.195ZDEBGoximeter (results-sink-cluster): inserting 1010 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
8592025-03-25T22:29:46.195ZDEBGoximeter (results-sink): inserting 1010 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
8602025-03-25T22:29:46.195ZDEBGoximeter (clickhouse-client): unrolling 1010 total samples collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
8612025-03-25T22:29:46.197ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
8622025-03-25T22:29:46.201ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:29:46.197432186Z } timeseries_name = oximeter_collector:collections
8632025-03-25T22:29:46.241ZDEBGoximeter (clickhouse-client): inserting 1 new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
8642025-03-25T22:29:46.245ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 24 table_name = fields_i16
8652025-03-25T22:29:46.246ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 12 table_name = fields_ipaddr
8662025-03-25T22:29:46.249ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 1390 table_name = fields_string
8672025-03-25T22:29:46.250ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 58 table_name = fields_u16
8682025-03-25T22:29:46.257ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 252 table_name = fields_u32
8692025-03-25T22:29:46.259ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 12 table_name = fields_u8
8702025-03-25T22:29:46.261ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 602 table_name = fields_uuid
8712025-03-25T22:29:46.263ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 952 table_name = measurements_cumulativeu64
8722025-03-25T22:29:46.266ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 34 table_name = measurements_histogramu64
8732025-03-25T22:29:46.270ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 24 table_name = measurements_u64
8742025-03-25T22:29:46.296ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
8752025-03-25T22:29:47.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
8762025-03-25T22:29:47.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
8772025-03-25T22:29:47.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
8782025-03-25T22:29:47.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
8792025-03-25T22:29:47.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
8802025-03-25T22:29:47.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
8812025-03-25T22:29:47.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
8822025-03-25T22:29:47.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
8832025-03-25T22:29:47.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
8842025-03-25T22:29:48.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
8852025-03-25T22:29:48.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
8862025-03-25T22:29:48.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
8872025-03-25T22:29:48.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
8882025-03-25T22:29:48.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
8892025-03-25T22:29:48.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
8902025-03-25T22:29:48.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
8912025-03-25T22:29:48.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
8922025-03-25T22:29:48.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
8932025-03-25T22:29:49.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
8942025-03-25T22:29:49.091ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
8952025-03-25T22:29:49.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
8962025-03-25T22:29:49.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
8972025-03-25T22:29:49.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
8982025-03-25T22:29:49.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
8992025-03-25T22:29:49.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9002025-03-25T22:29:49.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9012025-03-25T22:29:49.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9022025-03-25T22:29:49.824ZDEBGoximeter (results-sink-cluster): inserting 132 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
9032025-03-25T22:29:49.824ZDEBGoximeter (results-sink): inserting 132 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
9042025-03-25T22:29:49.824ZDEBGoximeter (clickhouse-client): unrolling 132 total samples collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
9052025-03-25T22:29:49.832ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 56 table_name = fields_string
9062025-03-25T22:29:49.834ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 64 table_name = fields_uuid
9072025-03-25T22:29:49.836ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 96 table_name = measurements_cumulativeu64
9082025-03-25T22:29:49.838ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 36 table_name = measurements_u64
9092025-03-25T22:29:49.925ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
9102025-03-25T22:29:50.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9112025-03-25T22:29:50.091ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9122025-03-25T22:29:50.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9132025-03-25T22:29:50.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9142025-03-25T22:29:50.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9152025-03-25T22:29:50.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9162025-03-25T22:29:50.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9172025-03-25T22:29:50.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9182025-03-25T22:29:50.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9192025-03-25T22:29:51.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9202025-03-25T22:29:51.091ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9212025-03-25T22:29:51.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9222025-03-25T22:29:51.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9232025-03-25T22:29:51.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9242025-03-25T22:29:51.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9252025-03-25T22:29:51.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9262025-03-25T22:29:51.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9272025-03-25T22:29:51.097ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9282025-03-25T22:29:52.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9292025-03-25T22:29:52.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9302025-03-25T22:29:52.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9312025-03-25T22:29:52.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9322025-03-25T22:29:52.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9332025-03-25T22:29:52.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9342025-03-25T22:29:52.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9352025-03-25T22:29:52.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9362025-03-25T22:29:52.097ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9372025-03-25T22:29:53.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9382025-03-25T22:29:53.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9392025-03-25T22:29:53.093ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9402025-03-25T22:29:53.093ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9412025-03-25T22:29:53.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9422025-03-25T22:29:53.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9432025-03-25T22:29:53.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9442025-03-25T22:29:53.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9452025-03-25T22:29:53.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9462025-03-25T22:29:54.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9472025-03-25T22:29:54.091ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9482025-03-25T22:29:54.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9492025-03-25T22:29:54.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9502025-03-25T22:29:54.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9512025-03-25T22:29:54.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9522025-03-25T22:29:54.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9532025-03-25T22:29:54.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9542025-03-25T22:29:54.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9552025-03-25T22:29:54.824ZDEBGoximeter (results-sink-cluster): inserting 220 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
9562025-03-25T22:29:54.824ZDEBGoximeter (results-sink): inserting 220 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
9572025-03-25T22:29:54.824ZDEBGoximeter (clickhouse-client): unrolling 220 total samples collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
9582025-03-25T22:29:54.835ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 56 table_name = fields_string
9592025-03-25T22:29:54.841ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 64 table_name = fields_uuid
9602025-03-25T22:29:54.849ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 160 table_name = measurements_cumulativeu64
9612025-03-25T22:29:54.855ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 60 table_name = measurements_u64
9622025-03-25T22:29:54.925ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
9632025-03-25T22:29:55.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9642025-03-25T22:29:55.091ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9652025-03-25T22:29:55.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9662025-03-25T22:29:55.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9672025-03-25T22:29:55.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9682025-03-25T22:29:55.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9692025-03-25T22:29:55.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9702025-03-25T22:29:55.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9712025-03-25T22:29:55.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9722025-03-25T22:29:56.083ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 56ee8e9a-ccae-49c2-ac33-94d5159567dd
9732025-03-25T22:29:56.083ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 56ee8e9a-ccae-49c2-ac33-94d5159567dd
9742025-03-25T22:29:56.086ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 94680e6f-9c70-48a1-afd3-ee3593739739
9752025-03-25T22:29:56.086ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 94680e6f-9c70-48a1-afd3-ee3593739739
9762025-03-25T22:29:56.090ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 090a0cc9-0d65-46af-9930-34d91d91522e
9772025-03-25T22:29:56.090ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 090a0cc9-0d65-46af-9930-34d91d91522e
9782025-03-25T22:29:56.091ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 2 producer_id = 090a0cc9-0d65-46af-9930-34d91d91522e
9792025-03-25T22:29:56.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9802025-03-25T22:29:56.091ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9812025-03-25T22:29:56.092ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 56ee8e9a-ccae-49c2-ac33-94d5159567dd
9822025-03-25T22:29:56.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9832025-03-25T22:29:56.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9842025-03-25T22:29:56.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9852025-03-25T22:29:56.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9862025-03-25T22:29:56.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9872025-03-25T22:29:56.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9882025-03-25T22:29:56.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
9892025-03-25T22:29:56.099ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 94680e6f-9c70-48a1-afd3-ee3593739739
9902025-03-25T22:29:56.109ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 22035ab1-4462-404d-8fdb-869e194ecaa9
9912025-03-25T22:29:56.109ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 22035ab1-4462-404d-8fdb-869e194ecaa9
9922025-03-25T22:29:56.114ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 5 producer_id = 22035ab1-4462-404d-8fdb-869e194ecaa9
9932025-03-25T22:29:57.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9942025-03-25T22:29:57.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9952025-03-25T22:29:57.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9962025-03-25T22:29:57.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9972025-03-25T22:29:57.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
9982025-03-25T22:29:57.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
9992025-03-25T22:29:57.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
10002025-03-25T22:29:57.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
10012025-03-25T22:29:57.097ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
10022025-03-25T22:29:58.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
10032025-03-25T22:29:58.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
10042025-03-25T22:29:58.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
10052025-03-25T22:29:58.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
10062025-03-25T22:29:58.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
10072025-03-25T22:29:58.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
10082025-03-25T22:29:58.096ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
10092025-03-25T22:29:58.096ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
10102025-03-25T22:29:58.097ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
10112025-03-25T22:29:59.092ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
10122025-03-25T22:29:59.092ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
10132025-03-25T22:29:59.093ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
10142025-03-25T22:29:59.093ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
10152025-03-25T22:29:59.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
10162025-03-25T22:29:59.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
10172025-03-25T22:29:59.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
10182025-03-25T22:29:59.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
10192025-03-25T22:29:59.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
10202025-03-25T22:29:59.824ZDEBGoximeter (results-sink-cluster): inserting 269 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
10212025-03-25T22:29:59.824ZDEBGoximeter (results-sink): inserting 269 samples into database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d
10222025-03-25T22:29:59.824ZDEBGoximeter (clickhouse-client): unrolling 269 total samples collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
10232025-03-25T22:29:59.827ZDEBGoximeter (clickhouse-client): retrieving timeseries schema from database collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
10242025-03-25T22:29:59.830ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 schema = TimeseriesSchema { timeseries_name: TimeseriesName("database_transaction:retry_data"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "attempt", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2025-03-25T22:29:59.827327618Z } timeseries_name = database_transaction:retry_data
10252025-03-25T22:29:59.838ZDEBGoximeter (clickhouse-client): inserting 1 new timeseries schema collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7
10262025-03-25T22:29:59.842ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 135 table_name = fields_string
10272025-03-25T22:29:59.844ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 39 table_name = fields_u16
10282025-03-25T22:29:59.846ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 1 table_name = fields_u32
10292025-03-25T22:29:59.848ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 112 table_name = fields_uuid
10302025-03-25T22:29:59.850ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 160 table_name = measurements_cumulativeu64
10312025-03-25T22:29:59.852ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 1 table_name = measurements_f64
10322025-03-25T22:29:59.854ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 39 table_name = measurements_histogramu64
10332025-03-25T22:29:59.856ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 9 table_name = measurements_i64
10342025-03-25T22:29:59.858ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d id = fdad28d3-dc8b-49a0-ae8d-ca2197170fe7 n_rows = 60 table_name = measurements_u64
10352025-03-25T22:29:59.925ZWARNoximeter (results-sink-cluster): failed to insert some results into metric DB collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:92
10362025-03-25T22:30:00.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
10372025-03-25T22:30:00.091ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
10382025-03-25T22:30:00.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
10392025-03-25T22:30:00.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
10402025-03-25T22:30:00.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
10412025-03-25T22:30:00.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
10422025-03-25T22:30:00.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
10432025-03-25T22:30:00.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
10442025-03-25T22:30:00.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
10452025-03-25T22:30:01.077ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
10462025-03-25T22:30:01.078ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?sort_by=id_ascending
10472025-03-25T22:30:01.082ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "472bb260-cc4c-40b2-8959-c6bfab66ecca", "content-length": "1412", "date": "Tue, 25 Mar 2025 22:30:01 GMT"} })
10482025-03-25T22:30:01.082ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmN2FjMTAxNy0zNmU3LTQwZWMtOTE3Mi1lNGUxNTQ1ZTczYzgifX0%3D
10492025-03-25T22:30:01.084ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/26728504-e36d-4baa-856d-cd0ce7a172a2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmN2FjMTAxNy0zNmU3LTQwZWMtOTE3Mi1lNGUxNTQ1ZTczYzgifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3d1f822-173b-4950-85b9-2d08b0ccdba2", "content-length": "29", "date": "Tue, 25 Mar 2025 22:30:01 GMT"} })
10502025-03-25T22:30:01.084ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:637 n_current_tasks = 9 n_pruned_tasks = 0
10512025-03-25T22:30:01.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
10522025-03-25T22:30:01.091ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
10532025-03-25T22:30:01.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
10542025-03-25T22:30:01.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
10552025-03-25T22:30:01.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
10562025-03-25T22:30:01.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
10572025-03-25T22:30:01.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
10582025-03-25T22:30:01.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
10592025-03-25T22:30:01.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
10602025-03-25T22:30:02.091ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
10612025-03-25T22:30:02.091ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
10622025-03-25T22:30:02.094ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 15fc47d5-e540-43f0-982f-3002a7fcde47
10632025-03-25T22:30:02.094ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
10642025-03-25T22:30:02.094ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
10652025-03-25T22:30:02.095ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6f8ee01e-f6de-4eac-9dbc-a24a49f6f0ef
10662025-03-25T22:30:02.095ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
10672025-03-25T22:30:02.095ZDEBGoximeter (collection-task): collecting from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72
10682025-03-25T22:30:02.096ZDEBGoximeter (collection-task): collected results from producer collector_id = 26728504-e36d-4baa-856d-cd0ce7a172a2 collector_ip = fd00:1122:3344:101::d n_results = 1 producer_id = 6fb0f743-7091-42c4-ab69-ca9f8aa75f72