Max level shown:
1 [ Jul 23 06:29:05 Enabled. ]
2 [ Jul 23 06:29:05 Rereading configuration. ]
3 [ Jul 23 06:29:06 Rereading configuration. ]
4 [ Jul 23 06:29:09 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id 8d64e386-09ab-4764-9378-ca7de6b05728 &"). ]
5 [ Jul 23 06:29:10 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-07-23T06:29:10.156ZDEBGoximeter: registered DTrace probes
82026-07-23T06:29:10.160ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:299
92026-07-23T06:29:10.160ZDEBGoximeter: creating ClickHouse client
102026-07-23T06:29:10.176ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
112026-07-23T06:29:14.599ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:888 id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
122026-07-23T06:29:14.599ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d
132026-07-23T06:29:14.599ZINFOoximeter (clickhouse-client): reading db version collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:788 id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
142026-07-23T06:29:14.600ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:888 id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
152026-07-23T06:29:14.600ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:793 id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 version = 0
162026-07-23T06:29:14.600ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:798 id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
172026-07-23T06:29:14.600ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
182026-07-23T06:29:14.731ZINFOoximeter (clickhouse-client): inserting current version collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:819 id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 version = 14
192026-07-23T06:29:14.754ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = aa67aaf5-a402-4ef0-95c5-edc689afe643
202026-07-23T06:29:14.760ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-07-23T06:29:14.760ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-07-23T06:29:14.760ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-07-23T06:29:14.760ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-07-23T06:29:14.760ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:335 local_addr = [fd00:1122:3344:101::d]:12223
252026-07-23T06:29:14.764ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-07-23T06:29:14.764ZDEBGoximeter: registered USDT probes
272026-07-23T06:29:14.764ZDEBGoximeter: contacting nexus
282026-07-23T06:29:14.787ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
292026-07-23T06:29:14.789ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::c]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
302026-07-23T06:29:14.789ZWARNoximeter: failed to contact nexus, will retry in 298.194479ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:413
312026-07-23T06:29:15.088ZDEBGoximeter: contacting nexus
322026-07-23T06:29:15.088ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
332026-07-23T06:29:15.088ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
342026-07-23T06:29:15.088ZWARNoximeter: failed to contact nexus, will retry in 379.261472ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:413
352026-07-23T06:29:15.468ZDEBGoximeter: contacting nexus
362026-07-23T06:29:15.468ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
372026-07-23T06:29:15.552ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "b73a5a80-df9f-4aa4-9098-627bb3e15cf8", "date": "Thu, 23 Jul 2026 06:29:15 GMT"} })
382026-07-23T06:29:15.552ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:431 id = 8d64e386-09ab-4764-9378-ca7de6b05728
392026-07-23T06:29:15.552ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:626
402026-07-23T06:29:15.553ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
412026-07-23T06:29:15.555ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/8d64e386-09ab-4764-9378-ca7de6b05728/producers?sort_by=id_ascending
422026-07-23T06:29:15.625ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/8d64e386-09ab-4764-9378-ca7de6b05728/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "63d590a7-5ce2-4e9b-b30e-45fee1d2e721", "content-length": "29", "date": "Thu, 23 Jul 2026 06:29:15 GMT"} })
432026-07-23T06:29:15.625ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 0 n_pruned_tasks = 0
442026-07-23T06:29:19.754ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_samples = 4
452026-07-23T06:29:19.754ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_samples = 4
462026-07-23T06:29:19.754ZDEBGoximeter (clickhouse-client): unrolling 4 total samples collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
472026-07-23T06:29:19.755ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
482026-07-23T06:29:19.757ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:database_queue_depth"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "collector_sink", field_type: String, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:19.755448297Z } timeseries_name = oximeter_collector:database_queue_depth
492026-07-23T06:29:19.757ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:database_samples_dropped"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "collector_sink", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:19.755431467Z } timeseries_name = oximeter_collector:database_samples_dropped
502026-07-23T06:29:19.757ZDEBGoximeter (clickhouse-client): inserting 2 new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
512026-07-23T06:29:19.763ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 4 table_name = fields_ipaddr
522026-07-23T06:29:19.765ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 4 table_name = fields_string
532026-07-23T06:29:19.768ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 4 table_name = fields_u16
542026-07-23T06:29:19.771ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 4 table_name = fields_uuid
552026-07-23T06:29:19.773ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 2 table_name = measurements_cumulativeu64
562026-07-23T06:29:19.776ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 2 table_name = measurements_histogramu64
572026-07-23T06:29:19.856ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
582026-07-23T06:29:24.755ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d
592026-07-23T06:29:24.755ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d
602026-07-23T06:29:29.755ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d
612026-07-23T06:29:29.755ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d
622026-07-23T06:29:30.554ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
632026-07-23T06:29:30.554ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/8d64e386-09ab-4764-9378-ca7de6b05728/producers?sort_by=id_ascending
642026-07-23T06:29:30.565ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/8d64e386-09ab-4764-9378-ca7de6b05728/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fddee49-a3f0-48bc-bf30-1e9e06721d9b", "content-length": "710", "date": "Thu, 23 Jul 2026 06:29:30 GMT"} })
652026-07-23T06:29:30.565ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/8d64e386-09ab-4764-9378-ca7de6b05728/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjMmExZTMwYS1kMjA2LTRlZmQtOGUzYS02YjkwMWJhYTc4NDQifX0%3D
662026-07-23T06:29:30.569ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/8d64e386-09ab-4764-9378-ca7de6b05728/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjMmExZTMwYS1kMjA2LTRlZmQtOGUzYS02YjkwMWJhYTc4NDQifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0fa98ec-b43f-4f80-bc88-72a9d08d9f46", "content-length": "29", "date": "Thu, 23 Jul 2026 06:29:30 GMT"} })
672026-07-23T06:29:30.569ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:53029 collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 695f0315-3113-4c5a-bd0b-8e673b4a118c
682026-07-23T06:29:30.569ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd
692026-07-23T06:29:30.569ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:34250 collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 765cbc21-b32e-4078-aeb7-32415290dfc1
702026-07-23T06:29:30.569ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844
712026-07-23T06:29:30.569ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 4 n_pruned_tasks = 0
722026-07-23T06:29:30.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
732026-07-23T06:29:30.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
742026-07-23T06:29:30.643ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
752026-07-23T06:29:31.373ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
762026-07-23T06:29:31.373ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
772026-07-23T06:29:31.381ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
782026-07-23T06:29:31.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
792026-07-23T06:29:31.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
802026-07-23T06:29:31.624ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
812026-07-23T06:29:32.374ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
822026-07-23T06:29:32.374ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
832026-07-23T06:29:32.375ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
842026-07-23T06:29:32.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
852026-07-23T06:29:32.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
862026-07-23T06:29:32.624ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
872026-07-23T06:29:33.373ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
882026-07-23T06:29:33.373ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
892026-07-23T06:29:33.374ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
902026-07-23T06:29:33.622ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
912026-07-23T06:29:33.622ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
922026-07-23T06:29:33.623ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
932026-07-23T06:29:34.374ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
942026-07-23T06:29:34.374ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
952026-07-23T06:29:34.375ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
962026-07-23T06:29:34.622ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
972026-07-23T06:29:34.622ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
982026-07-23T06:29:34.623ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
992026-07-23T06:29:34.754ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_samples = 76
1002026-07-23T06:29:34.754ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_samples = 76
1012026-07-23T06:29:34.754ZDEBGoximeter (clickhouse-client): unrolling 76 total samples collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
1022026-07-23T06:29:34.754ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
1032026-07-23T06:29:34.760ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:34.754776710Z } timeseries_name = ddm_router:originated_tunnel_endpoints
1042026-07-23T06:29:34.760ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:34.754775190Z } timeseries_name = ddm_router:originated_underlay_prefixes
1052026-07-23T06:29:34.760ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:34.754783790Z } timeseries_name = ddm_session:advertisements_received
1062026-07-23T06:29:34.760ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:34.754781870Z } timeseries_name = ddm_session:advertisements_sent
1072026-07-23T06:29:34.760ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:34.754798050Z } timeseries_name = ddm_session:imported_tunnel_endpoints
1082026-07-23T06:29:34.760ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:34.754796060Z } timeseries_name = ddm_session:imported_underlay_prefixes
1092026-07-23T06:29:34.760ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:34.754787040Z } timeseries_name = ddm_session:peer_address_changes
1102026-07-23T06:29:34.760ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:34.754785660Z } timeseries_name = ddm_session:peer_expirations
1112026-07-23T06:29:34.760ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:34.754789800Z } timeseries_name = ddm_session:peer_sessions_established
1122026-07-23T06:29:34.760ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:34.754780030Z } timeseries_name = ddm_session:solicitations_received
1132026-07-23T06:29:34.760ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:34.754778299Z } timeseries_name = ddm_session:solicitations_sent
1142026-07-23T06:29:34.760ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:34.754794330Z } timeseries_name = ddm_session:update_send_fail
1152026-07-23T06:29:34.760ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:34.754792760Z } timeseries_name = ddm_session:updates_received
1162026-07-23T06:29:34.760ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:34.754791550Z } timeseries_name = ddm_session:updates_sent
1172026-07-23T06:29:34.760ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:34.754772690Z } timeseries_name = mg_lower:routes_blocked_by_link_state
1182026-07-23T06:29:34.760ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:34.754769219Z } timeseries_name = static_routing_config:static_nexthops
1192026-07-23T06:29:34.760ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:34.754766059Z } timeseries_name = static_routing_config:static_routes
1202026-07-23T06:29:34.761ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:34.754771290Z } timeseries_name = switch_rib:active_routes
1212026-07-23T06:29:34.761ZDEBGoximeter (clickhouse-client): inserting 18 new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
1222026-07-23T06:29:34.768ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 30 table_name = fields_string
1232026-07-23T06:29:34.770ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 36 table_name = fields_uuid
1242026-07-23T06:29:34.774ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 50 table_name = measurements_cumulativeu64
1252026-07-23T06:29:34.775ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 26 table_name = measurements_u64
1262026-07-23T06:29:34.855ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1272026-07-23T06:29:35.373ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1282026-07-23T06:29:35.373ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1292026-07-23T06:29:35.374ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1302026-07-23T06:29:35.622ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1312026-07-23T06:29:35.622ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1322026-07-23T06:29:35.623ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1332026-07-23T06:29:36.374ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1342026-07-23T06:29:36.374ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1352026-07-23T06:29:36.375ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1362026-07-23T06:29:36.622ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1372026-07-23T06:29:36.622ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1382026-07-23T06:29:36.623ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1392026-07-23T06:29:37.017ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 695f0315-3113-4c5a-bd0b-8e673b4a118c producer_ip = fd00:1122:3344:101::b producer_port = 53029
1402026-07-23T06:29:37.017ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 695f0315-3113-4c5a-bd0b-8e673b4a118c producer_ip = fd00:1122:3344:101::b producer_port = 53029
1412026-07-23T06:29:37.032ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 16 producer_id = 695f0315-3113-4c5a-bd0b-8e673b4a118c producer_ip = fd00:1122:3344:101::b producer_port = 53029
1422026-07-23T06:29:37.068ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 765cbc21-b32e-4078-aeb7-32415290dfc1 producer_ip = fd00:1122:3344:101::c producer_port = 34250
1432026-07-23T06:29:37.068ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 765cbc21-b32e-4078-aeb7-32415290dfc1 producer_ip = fd00:1122:3344:101::c producer_port = 34250
1442026-07-23T06:29:37.073ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 765cbc21-b32e-4078-aeb7-32415290dfc1 producer_ip = fd00:1122:3344:101::c producer_port = 34250
1452026-07-23T06:29:37.374ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1462026-07-23T06:29:37.374ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1472026-07-23T06:29:37.376ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1482026-07-23T06:29:37.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1492026-07-23T06:29:37.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1502026-07-23T06:29:37.624ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1512026-07-23T06:29:38.374ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1522026-07-23T06:29:38.374ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1532026-07-23T06:29:38.375ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1542026-07-23T06:29:38.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1552026-07-23T06:29:38.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1562026-07-23T06:29:38.624ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1572026-07-23T06:29:39.374ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1582026-07-23T06:29:39.374ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1592026-07-23T06:29:39.375ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1602026-07-23T06:29:39.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1612026-07-23T06:29:39.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1622026-07-23T06:29:39.623ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1632026-07-23T06:29:39.754ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_samples = 108
1642026-07-23T06:29:39.754ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_samples = 108
1652026-07-23T06:29:39.754ZDEBGoximeter (clickhouse-client): unrolling 108 total samples collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
1662026-07-23T06:29:39.755ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
1672026-07-23T06:29:39.799ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:39.754968893Z } timeseries_name = collection_target:cpus_provisioned
1682026-07-23T06:29:39.799ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:39.754969913Z } timeseries_name = collection_target:ram_provisioned
1692026-07-23T06:29:39.799ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:39.754971163Z } timeseries_name = collection_target:virtual_disk_space_provisioned
1702026-07-23T06:29:39.799ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:39.754966603Z } timeseries_name = http_service:request_latency_histogram
1712026-07-23T06:29:39.800ZDEBGoximeter (clickhouse-client): inserting 4 new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
1722026-07-23T06:29:39.803ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 42 table_name = fields_string
1732026-07-23T06:29:39.805ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 6 table_name = fields_u16
1742026-07-23T06:29:39.806ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 54 table_name = fields_uuid
1752026-07-23T06:29:39.808ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 60 table_name = measurements_cumulativeu64
1762026-07-23T06:29:39.817ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 6 table_name = measurements_histogramu64
1772026-07-23T06:29:39.818ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 12 table_name = measurements_i64
1782026-07-23T06:29:39.819ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 30 table_name = measurements_u64
1792026-07-23T06:29:39.856ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1802026-07-23T06:29:40.373ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1812026-07-23T06:29:40.374ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1822026-07-23T06:29:40.374ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1832026-07-23T06:29:40.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1842026-07-23T06:29:40.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1852026-07-23T06:29:40.623ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1862026-07-23T06:29:41.373ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1872026-07-23T06:29:41.373ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1882026-07-23T06:29:41.375ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1892026-07-23T06:29:41.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1902026-07-23T06:29:41.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1912026-07-23T06:29:41.624ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1922026-07-23T06:29:42.373ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1932026-07-23T06:29:42.373ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1942026-07-23T06:29:42.376ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1952026-07-23T06:29:42.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1962026-07-23T06:29:42.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1972026-07-23T06:29:42.624ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
1982026-07-23T06:29:43.374ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
1992026-07-23T06:29:43.374ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2002026-07-23T06:29:43.375ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2012026-07-23T06:29:43.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2022026-07-23T06:29:43.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2032026-07-23T06:29:43.624ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2042026-07-23T06:29:44.374ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2052026-07-23T06:29:44.374ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2062026-07-23T06:29:44.375ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2072026-07-23T06:29:44.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2082026-07-23T06:29:44.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2092026-07-23T06:29:44.624ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2102026-07-23T06:29:44.755ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_samples = 90
2112026-07-23T06:29:44.755ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_samples = 90
2122026-07-23T06:29:44.755ZDEBGoximeter (clickhouse-client): unrolling 90 total samples collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
2132026-07-23T06:29:44.755ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
2142026-07-23T06:29:44.768ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 30 table_name = fields_string
2152026-07-23T06:29:44.769ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 36 table_name = fields_uuid
2162026-07-23T06:29:44.771ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 60 table_name = measurements_cumulativeu64
2172026-07-23T06:29:44.772ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 30 table_name = measurements_u64
2182026-07-23T06:29:44.856ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2192026-07-23T06:29:45.374ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2202026-07-23T06:29:45.374ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2212026-07-23T06:29:45.375ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2222026-07-23T06:29:45.553ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
2232026-07-23T06:29:45.553ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/8d64e386-09ab-4764-9378-ca7de6b05728/producers?sort_by=id_ascending
2242026-07-23T06:29:45.558ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/8d64e386-09ab-4764-9378-ca7de6b05728/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "714b5c75-90a1-4675-b7ea-826744e91c37", "content-length": "710", "date": "Thu, 23 Jul 2026 06:29:45 GMT"} })
2252026-07-23T06:29:45.558ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/8d64e386-09ab-4764-9378-ca7de6b05728/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjMmExZTMwYS1kMjA2LTRlZmQtOGUzYS02YjkwMWJhYTc4NDQifX0%3D
2262026-07-23T06:29:45.565ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/8d64e386-09ab-4764-9378-ca7de6b05728/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjMmExZTMwYS1kMjA2LTRlZmQtOGUzYS02YjkwMWJhYTc4NDQifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "733aa3fb-7e85-4e2f-95e1-53ce313ab6f3", "content-length": "29", "date": "Thu, 23 Jul 2026 06:29:45 GMT"} })
2272026-07-23T06:29:45.565ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 4 n_pruned_tasks = 0
2282026-07-23T06:29:45.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2292026-07-23T06:29:45.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2302026-07-23T06:29:45.624ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2312026-07-23T06:29:46.374ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2322026-07-23T06:29:46.374ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2332026-07-23T06:29:46.375ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2342026-07-23T06:29:46.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2352026-07-23T06:29:46.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2362026-07-23T06:29:46.623ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2372026-07-23T06:29:47.017ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 695f0315-3113-4c5a-bd0b-8e673b4a118c producer_ip = fd00:1122:3344:101::b producer_port = 53029
2382026-07-23T06:29:47.017ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 695f0315-3113-4c5a-bd0b-8e673b4a118c producer_ip = fd00:1122:3344:101::b producer_port = 53029
2392026-07-23T06:29:47.019ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 36 producer_id = 695f0315-3113-4c5a-bd0b-8e673b4a118c producer_ip = fd00:1122:3344:101::b producer_port = 53029
2402026-07-23T06:29:47.068ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 765cbc21-b32e-4078-aeb7-32415290dfc1 producer_ip = fd00:1122:3344:101::c producer_port = 34250
2412026-07-23T06:29:47.068ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 765cbc21-b32e-4078-aeb7-32415290dfc1 producer_ip = fd00:1122:3344:101::c producer_port = 34250
2422026-07-23T06:29:47.068ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 765cbc21-b32e-4078-aeb7-32415290dfc1 producer_ip = fd00:1122:3344:101::c producer_port = 34250
2432026-07-23T06:29:47.374ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2442026-07-23T06:29:47.374ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2452026-07-23T06:29:47.375ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2462026-07-23T06:29:47.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2472026-07-23T06:29:47.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2482026-07-23T06:29:47.623ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2492026-07-23T06:29:48.373ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2502026-07-23T06:29:48.374ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2512026-07-23T06:29:48.375ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2522026-07-23T06:29:48.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2532026-07-23T06:29:48.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2542026-07-23T06:29:48.623ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2552026-07-23T06:29:49.373ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2562026-07-23T06:29:49.374ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2572026-07-23T06:29:49.375ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2582026-07-23T06:29:49.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2592026-07-23T06:29:49.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2602026-07-23T06:29:49.623ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2612026-07-23T06:29:49.754ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_samples = 128
2622026-07-23T06:29:49.755ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_samples = 128
2632026-07-23T06:29:49.755ZDEBGoximeter (clickhouse-client): unrolling 128 total samples collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
2642026-07-23T06:29:49.755ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
2652026-07-23T06:29:49.760ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 76 table_name = fields_string
2662026-07-23T06:29:49.762ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 23 table_name = fields_u16
2672026-07-23T06:29:49.763ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 67 table_name = fields_uuid
2682026-07-23T06:29:49.764ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 60 table_name = measurements_cumulativeu64
2692026-07-23T06:29:49.766ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 23 table_name = measurements_histogramu64
2702026-07-23T06:29:49.767ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 15 table_name = measurements_i64
2712026-07-23T06:29:49.768ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 30 table_name = measurements_u64
2722026-07-23T06:29:49.856ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2732026-07-23T06:29:50.374ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2742026-07-23T06:29:50.374ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2752026-07-23T06:29:50.375ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2762026-07-23T06:29:50.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2772026-07-23T06:29:50.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2782026-07-23T06:29:50.624ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2792026-07-23T06:29:50.895ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 765cbc21-b32e-4078-aeb7-32415290dfc1 producer_ip = fd00:1122:3344:101::c producer_port = 34250
2802026-07-23T06:29:51.373ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2812026-07-23T06:29:51.373ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2822026-07-23T06:29:51.374ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2832026-07-23T06:29:51.622ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2842026-07-23T06:29:51.622ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2852026-07-23T06:29:51.623ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2862026-07-23T06:29:52.374ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2872026-07-23T06:29:52.374ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2882026-07-23T06:29:52.375ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2892026-07-23T06:29:52.622ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2902026-07-23T06:29:52.622ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2912026-07-23T06:29:52.623ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2922026-07-23T06:29:53.373ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2932026-07-23T06:29:53.373ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2942026-07-23T06:29:53.374ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2952026-07-23T06:29:53.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2962026-07-23T06:29:53.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2972026-07-23T06:29:53.623ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
2982026-07-23T06:29:53.954ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2992026-07-23T06:29:54.374ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3002026-07-23T06:29:54.374ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3012026-07-23T06:29:54.375ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3022026-07-23T06:29:54.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3032026-07-23T06:29:54.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3042026-07-23T06:29:54.624ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3052026-07-23T06:29:54.755ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_samples = 94
3062026-07-23T06:29:54.755ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_samples = 94
3072026-07-23T06:29:54.755ZDEBGoximeter (clickhouse-client): unrolling 94 total samples collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
3082026-07-23T06:29:54.755ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
3092026-07-23T06:29:54.758ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:54.755237801Z } timeseries_name = oximeter_collector:collections
3102026-07-23T06:29:54.758ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:samples_collected"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-23T06:29:54.755239741Z } timeseries_name = oximeter_collector:samples_collected
3112026-07-23T06:29:54.758ZDEBGoximeter (clickhouse-client): inserting 2 new timeseries schema collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
3122026-07-23T06:29:54.761ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 8 table_name = fields_ipaddr
3132026-07-23T06:29:54.763ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 34 table_name = fields_string
3142026-07-23T06:29:54.764ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 8 table_name = fields_u16
3152026-07-23T06:29:54.766ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 44 table_name = fields_uuid
3162026-07-23T06:29:54.767ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 64 table_name = measurements_cumulativeu64
3172026-07-23T06:29:54.768ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 30 table_name = measurements_u64
3182026-07-23T06:29:54.856ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
3192026-07-23T06:29:55.374ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3202026-07-23T06:29:55.374ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3212026-07-23T06:29:55.375ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3222026-07-23T06:29:55.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3232026-07-23T06:29:55.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3242026-07-23T06:29:55.623ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3252026-07-23T06:29:56.374ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3262026-07-23T06:29:56.374ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3272026-07-23T06:29:56.375ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3282026-07-23T06:29:56.622ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3292026-07-23T06:29:56.622ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3302026-07-23T06:29:56.623ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3312026-07-23T06:29:57.017ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 695f0315-3113-4c5a-bd0b-8e673b4a118c producer_ip = fd00:1122:3344:101::b producer_port = 53029
3322026-07-23T06:29:57.017ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 695f0315-3113-4c5a-bd0b-8e673b4a118c producer_ip = fd00:1122:3344:101::b producer_port = 53029
3332026-07-23T06:29:57.019ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = 695f0315-3113-4c5a-bd0b-8e673b4a118c producer_ip = fd00:1122:3344:101::b producer_port = 53029
3342026-07-23T06:29:57.067ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 765cbc21-b32e-4078-aeb7-32415290dfc1 producer_ip = fd00:1122:3344:101::c producer_port = 34250
3352026-07-23T06:29:57.068ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 765cbc21-b32e-4078-aeb7-32415290dfc1 producer_ip = fd00:1122:3344:101::c producer_port = 34250
3362026-07-23T06:29:57.068ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 2 producer_id = 765cbc21-b32e-4078-aeb7-32415290dfc1 producer_ip = fd00:1122:3344:101::c producer_port = 34250
3372026-07-23T06:29:57.373ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3382026-07-23T06:29:57.373ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3392026-07-23T06:29:57.375ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3402026-07-23T06:29:57.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3412026-07-23T06:29:57.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3422026-07-23T06:29:57.623ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3432026-07-23T06:29:58.373ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3442026-07-23T06:29:58.374ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3452026-07-23T06:29:58.375ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3462026-07-23T06:29:58.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3472026-07-23T06:29:58.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3482026-07-23T06:29:58.623ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3492026-07-23T06:29:59.374ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3502026-07-23T06:29:59.374ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3512026-07-23T06:29:59.375ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3522026-07-23T06:29:59.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3532026-07-23T06:29:59.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3542026-07-23T06:29:59.623ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3552026-07-23T06:29:59.755ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_samples = 115
3562026-07-23T06:29:59.755ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_samples = 115
3572026-07-23T06:29:59.755ZDEBGoximeter (clickhouse-client): unrolling 115 total samples collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
3582026-07-23T06:29:59.755ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200
3592026-07-23T06:29:59.762ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 80 table_name = fields_string
3602026-07-23T06:29:59.763ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 25 table_name = fields_u16
3612026-07-23T06:29:59.764ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 61 table_name = fields_uuid
3622026-07-23T06:29:59.766ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 60 table_name = measurements_cumulativeu64
3632026-07-23T06:29:59.767ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 25 table_name = measurements_histogramu64
3642026-07-23T06:29:59.768ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d id = a2e8aae0-3bc0-4961-bd1d-0707526ab200 n_rows = 30 table_name = measurements_u64
3652026-07-23T06:29:59.856ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
3662026-07-23T06:30:00.373ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3672026-07-23T06:30:00.374ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3682026-07-23T06:30:00.374ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3692026-07-23T06:30:00.554ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
3702026-07-23T06:30:00.554ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/8d64e386-09ab-4764-9378-ca7de6b05728/producers?sort_by=id_ascending
3712026-07-23T06:30:00.558ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/8d64e386-09ab-4764-9378-ca7de6b05728/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e813b99-b091-4b9e-bb36-8730d17640d8", "content-length": "1133", "date": "Thu, 23 Jul 2026 06:30:00 GMT"} })
3722026-07-23T06:30:00.558ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/8d64e386-09ab-4764-9378-ca7de6b05728/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjMmExZTMwYS1kMjA2LTRlZmQtOGUzYS02YjkwMWJhYTc4NDQifX0%3D
3732026-07-23T06:30:00.562ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/8d64e386-09ab-4764-9378-ca7de6b05728/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjMmExZTMwYS1kMjA2LTRlZmQtOGUzYS02YjkwMWJhYTc4NDQifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "55b99107-da1f-4f1a-b5b6-ed259f7b83a1", "content-length": "29", "date": "Thu, 23 Jul 2026 06:30:00 GMT"} })
3742026-07-23T06:30:00.562ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 584efa3b-643e-4759-96dd-3424f67fe147
3752026-07-23T06:30:00.562ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:42865 collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 77d424c4-2818-45ce-ac22-c099894b658b
3762026-07-23T06:30:00.562ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:52334 collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 7b05276b-db5d-432c-b5cb-309f314b5e8c
3772026-07-23T06:30:00.562ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 7 n_pruned_tasks = 0
3782026-07-23T06:30:00.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3792026-07-23T06:30:00.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3802026-07-23T06:30:00.623ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3812026-07-23T06:30:00.664ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 584efa3b-643e-4759-96dd-3424f67fe147 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3822026-07-23T06:30:00.664ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 584efa3b-643e-4759-96dd-3424f67fe147 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3832026-07-23T06:30:00.670ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 584efa3b-643e-4759-96dd-3424f67fe147 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3842026-07-23T06:30:01.373ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3852026-07-23T06:30:01.373ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3862026-07-23T06:30:01.375ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = c2a1e30a-d206-4efd-8e3a-6b901baa7844 producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3872026-07-23T06:30:01.623ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3882026-07-23T06:30:01.623ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3892026-07-23T06:30:01.623ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 716c82ac-40be-4c1b-8997-7962788d0dbd producer_ip = fd00:1122:3344:101::2 producer_port = 4677
3902026-07-23T06:30:01.664ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 584efa3b-643e-4759-96dd-3424f67fe147 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3912026-07-23T06:30:01.664ZDEBGoximeter (collection-task): collecting from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d producer_id = 584efa3b-643e-4759-96dd-3424f67fe147 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3922026-07-23T06:30:01.666ZDEBGoximeter (collection-task): collected results from producer collector_id = 8d64e386-09ab-4764-9378-ca7de6b05728 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 584efa3b-643e-4759-96dd-3424f67fe147 producer_ip = fd00:1122:3344:101::1 producer_port = 8001