Max level shown:
1 [ Jul 28 03:12:43 Enabled. ]
2 [ Jul 28 03:12:43 Rereading configuration. ]
3 [ Jul 28 03:12:46 Rereading configuration. ]
4 [ Jul 28 03:12:51 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 &"). ]
5 [ Jul 28 03:12:51 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-07-28T03:12:52.091ZDEBGoximeter: registered DTrace probes
82026-07-28T03:12:52.096ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:299
92026-07-28T03:12:52.099ZDEBGoximeter: creating ClickHouse client
102026-07-28T03:12:52.109ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
112026-07-28T03:12:54.535ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:888 id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
122026-07-28T03:12:54.535ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d
132026-07-28T03:12:54.535ZINFOoximeter (clickhouse-client): reading db version collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:788 id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
142026-07-28T03:12:54.536ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:888 id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
152026-07-28T03:12:54.536ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:793 id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 version = 0
162026-07-28T03:12:54.536ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:798 id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
172026-07-28T03:12:54.536ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
182026-07-28T03:12:54.776ZINFOoximeter (clickhouse-client): inserting current version collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:819 id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 version = 14
192026-07-28T03:12:54.794ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = 42c1bfe2-debc-4473-8067-f831b42ab674
202026-07-28T03:12:54.802ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-07-28T03:12:54.802ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-07-28T03:12:54.802ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-07-28T03:12:54.802ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-07-28T03:12:54.802ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:335 local_addr = [fd00:1122:3344:101::d]:12223
252026-07-28T03:12:54.806ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-07-28T03:12:54.808ZDEBGoximeter: registered USDT probes
272026-07-28T03:12:54.808ZDEBGoximeter: contacting nexus
282026-07-28T03:12:54.833ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
292026-07-28T03:12:54.834ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
302026-07-28T03:12:54.834ZWARNoximeter: failed to contact nexus, will retry in 328.270705ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:413
312026-07-28T03:12:55.163ZDEBGoximeter: contacting nexus
322026-07-28T03:12:55.163ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
332026-07-28T03:12:55.164ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
342026-07-28T03:12:55.164ZWARNoximeter: failed to contact nexus, will retry in 355.542691ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:413
352026-07-28T03:12:55.520ZDEBGoximeter: contacting nexus
362026-07-28T03:12:55.520ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
372026-07-28T03:12:55.520ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
382026-07-28T03:12:55.520ZWARNoximeter: failed to contact nexus, will retry in 744.174232ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:413
392026-07-28T03:12:56.265ZDEBGoximeter: contacting nexus
402026-07-28T03:12:56.265ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
412026-07-28T03:12:56.266ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
422026-07-28T03:12:56.266ZWARNoximeter: failed to contact nexus, will retry in 2.601217826s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:413
432026-07-28T03:12:58.868ZDEBGoximeter: contacting nexus
442026-07-28T03:12:58.868ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
452026-07-28T03:12:58.909ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "665539be-e897-4e3a-95eb-1c34a6dac71b", "date": "Tue, 28 Jul 2026 03:12:58 GMT"} })
462026-07-28T03:12:58.909ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:431 id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8
472026-07-28T03:12:58.909ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:626
482026-07-28T03:12:58.910ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
492026-07-28T03:12:58.914ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?sort_by=id_ascending
502026-07-28T03:12:58.947ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2f21253-9fb3-40a3-9226-45192f0452c7", "content-length": "29", "date": "Tue, 28 Jul 2026 03:12:58 GMT"} })
512026-07-28T03:12:58.948ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 0 n_pruned_tasks = 0
522026-07-28T03:12:59.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 4
532026-07-28T03:12:59.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 4
542026-07-28T03:12:59.795ZDEBGoximeter (clickhouse-client): unrolling 4 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
552026-07-28T03:12:59.796ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
562026-07-28T03:12:59.798ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:database_queue_depth"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "collector_sink", field_type: String, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:12:59.796433090Z } timeseries_name = oximeter_collector:database_queue_depth
572026-07-28T03:12:59.798ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:database_samples_dropped"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "collector_sink", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:12:59.796428350Z } timeseries_name = oximeter_collector:database_samples_dropped
582026-07-28T03:12:59.798ZDEBGoximeter (clickhouse-client): inserting 2 new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
592026-07-28T03:12:59.804ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 4 table_name = fields_ipaddr
602026-07-28T03:12:59.806ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 4 table_name = fields_string
612026-07-28T03:12:59.808ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 4 table_name = fields_u16
622026-07-28T03:12:59.812ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 4 table_name = fields_uuid
632026-07-28T03:12:59.814ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 2 table_name = measurements_cumulativeu64
642026-07-28T03:12:59.816ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 2 table_name = measurements_histogramu64
652026-07-28T03:12:59.896ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
662026-07-28T03:13:04.795ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d
672026-07-28T03:13:04.795ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d
682026-07-28T03:13:09.795ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d
692026-07-28T03:13:09.795ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d
702026-07-28T03:13:13.911ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
712026-07-28T03:13:13.911ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?sort_by=id_ascending
722026-07-28T03:13:13.944ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "b12de011-5ebd-482c-b0a4-2ede5de72432", "content-length": "438", "date": "Tue, 28 Jul 2026 03:13:13 GMT"} })
732026-07-28T03:13:13.947ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWUxYTBhZS1iN2ViLTRmNjYtYjQzZS1lNTUxODZkMWM4NTEifX0%3D
742026-07-28T03:13:13.951ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWUxYTBhZS1iN2ViLTRmNjYtYjQzZS1lNTUxODZkMWM4NTEifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "f05a0878-5f80-4c21-b1a0-aa36ba4eb080", "content-length": "29", "date": "Tue, 28 Jul 2026 03:13:13 GMT"} })
752026-07-28T03:13:13.951ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::a]:49688 collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805
762026-07-28T03:13:13.951ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:49513 collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851
772026-07-28T03:13:13.951ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 2 n_pruned_tasks = 0
782026-07-28T03:13:14.795ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d
792026-07-28T03:13:14.795ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d
802026-07-28T03:13:15.409ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
812026-07-28T03:13:19.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 2
822026-07-28T03:13:19.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 2
832026-07-28T03:13:19.795ZDEBGoximeter (clickhouse-client): unrolling 2 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
842026-07-28T03:13:19.795ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
852026-07-28T03:13:19.799ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:19.795835035Z } timeseries_name = oximeter_collector:collections
862026-07-28T03:13:19.799ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:samples_collected"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:19.795839835Z } timeseries_name = oximeter_collector:samples_collected
872026-07-28T03:13:19.799ZDEBGoximeter (clickhouse-client): inserting 2 new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
882026-07-28T03:13:19.802ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 4 table_name = fields_ipaddr
892026-07-28T03:13:19.803ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 2 table_name = fields_string
902026-07-28T03:13:19.804ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 4 table_name = fields_u16
912026-07-28T03:13:19.805ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 4 table_name = fields_uuid
922026-07-28T03:13:19.807ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 2 table_name = measurements_cumulativeu64
932026-07-28T03:13:19.896ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
942026-07-28T03:13:23.750ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
952026-07-28T03:13:23.750ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
962026-07-28T03:13:23.776ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 29 producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
972026-07-28T03:13:24.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 29
982026-07-28T03:13:24.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 29
992026-07-28T03:13:24.795ZDEBGoximeter (clickhouse-client): unrolling 29 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
1002026-07-28T03:13:24.795ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
1012026-07-28T03:13:24.796ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:cpus_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:24.795246934Z } timeseries_name = collection_target:cpus_provisioned
1022026-07-28T03:13:24.796ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:ram_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:24.795248434Z } timeseries_name = collection_target:ram_provisioned
1032026-07-28T03:13:24.796ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("collection_target:virtual_disk_space_provisioned"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }}, datum_type: I64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:24.795254237Z } timeseries_name = collection_target:virtual_disk_space_provisioned
1042026-07-28T03:13:24.796ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("http_service:request_latency_histogram"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }, FieldSchema { name: "operation_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "status_code", field_type: U16, source: Metric, description: "" }}, datum_type: HistogramU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:24.795241674Z } timeseries_name = http_service:request_latency_histogram
1052026-07-28T03:13:24.797ZDEBGoximeter (clickhouse-client): inserting 4 new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
1062026-07-28T03:13:24.802ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 34 table_name = fields_string
1072026-07-28T03:13:24.803ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 17 table_name = fields_u16
1082026-07-28T03:13:24.804ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 24 table_name = fields_uuid
1092026-07-28T03:13:24.806ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 17 table_name = measurements_histogramu64
1102026-07-28T03:13:24.807ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 12 table_name = measurements_i64
1112026-07-28T03:13:24.897ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1122026-07-28T03:13:28.910ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
1132026-07-28T03:13:28.910ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?sort_by=id_ascending
1142026-07-28T03:13:28.914ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5501593-fee2-4e8e-a6cc-f3da8021975f", "content-length": "574", "date": "Tue, 28 Jul 2026 03:13:28 GMT"} })
1152026-07-28T03:13:28.914ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWUxYTBhZS1iN2ViLTRmNjYtYjQzZS1lNTUxODZkMWM4NTEifX0%3D
1162026-07-28T03:13:28.927ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWUxYTBhZS1iN2ViLTRmNjYtYjQzZS1lNTUxODZkMWM4NTEifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d73406c-0c14-4709-bd4e-4f6182c8b341", "content-length": "29", "date": "Tue, 28 Jul 2026 03:13:28 GMT"} })
1172026-07-28T03:13:28.927ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e
1182026-07-28T03:13:28.927ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 3 n_pruned_tasks = 0
1192026-07-28T03:13:29.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1202026-07-28T03:13:29.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1212026-07-28T03:13:29.728ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1222026-07-28T03:13:29.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 26
1232026-07-28T03:13:29.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 26
1242026-07-28T03:13:29.795ZDEBGoximeter (clickhouse-client): unrolling 26 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
1252026-07-28T03:13:29.795ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
1262026-07-28T03:13:29.824ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:29.795531940Z } timeseries_name = ddm_router:originated_tunnel_endpoints
1272026-07-28T03:13:29.824ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:29.795529140Z } timeseries_name = ddm_router:originated_underlay_prefixes
1282026-07-28T03:13:29.824ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:29.795554521Z } timeseries_name = ddm_session:advertisements_received
1292026-07-28T03:13:29.824ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:29.795552530Z } timeseries_name = ddm_session:advertisements_sent
1302026-07-28T03:13:29.824ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:29.795579541Z } timeseries_name = ddm_session:imported_tunnel_endpoints
1312026-07-28T03:13:29.824ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:29.795578111Z } timeseries_name = ddm_session:imported_underlay_prefixes
1322026-07-28T03:13:29.824ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:29.795557401Z } timeseries_name = ddm_session:peer_address_changes
1332026-07-28T03:13:29.824ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:29.795555991Z } timeseries_name = ddm_session:peer_expirations
1342026-07-28T03:13:29.824ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:29.795559681Z } timeseries_name = ddm_session:peer_sessions_established
1352026-07-28T03:13:29.824ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:29.795535270Z } timeseries_name = ddm_session:solicitations_received
1362026-07-28T03:13:29.824ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:29.795533790Z } timeseries_name = ddm_session:solicitations_sent
1372026-07-28T03:13:29.824ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:29.795575671Z } timeseries_name = ddm_session:update_send_fail
1382026-07-28T03:13:29.824ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:29.795574381Z } timeseries_name = ddm_session:updates_received
1392026-07-28T03:13:29.824ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:29.795562171Z } timeseries_name = ddm_session:updates_sent
1402026-07-28T03:13:29.824ZDEBGoximeter (clickhouse-client): inserting 14 new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
1412026-07-28T03:13:29.827ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 50 table_name = fields_string
1422026-07-28T03:13:29.828ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 52 table_name = fields_uuid
1432026-07-28T03:13:29.830ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 20 table_name = measurements_cumulativeu64
1442026-07-28T03:13:29.831ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 6 table_name = measurements_u64
1452026-07-28T03:13:29.896ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1462026-07-28T03:13:30.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1472026-07-28T03:13:30.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1482026-07-28T03:13:30.727ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1492026-07-28T03:13:31.139ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1502026-07-28T03:13:31.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1512026-07-28T03:13:31.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1522026-07-28T03:13:31.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1532026-07-28T03:13:32.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1542026-07-28T03:13:32.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1552026-07-28T03:13:32.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1562026-07-28T03:13:33.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1572026-07-28T03:13:33.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1582026-07-28T03:13:33.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1592026-07-28T03:13:33.750ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
1602026-07-28T03:13:33.750ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
1612026-07-28T03:13:33.752ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 29 producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
1622026-07-28T03:13:34.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1632026-07-28T03:13:34.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1642026-07-28T03:13:34.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1652026-07-28T03:13:34.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 161
1662026-07-28T03:13:34.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 161
1672026-07-28T03:13:34.795ZDEBGoximeter (clickhouse-client): unrolling 161 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
1682026-07-28T03:13:34.795ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
1692026-07-28T03:13:34.812ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 4 table_name = fields_ipaddr
1702026-07-28T03:13:34.813ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 98 table_name = fields_string
1712026-07-28T03:13:34.815ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 27 table_name = fields_u16
1722026-07-28T03:13:34.816ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 84 table_name = fields_uuid
1732026-07-28T03:13:34.817ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 102 table_name = measurements_cumulativeu64
1742026-07-28T03:13:34.819ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 23 table_name = measurements_histogramu64
1752026-07-28T03:13:34.821ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 6 table_name = measurements_i64
1762026-07-28T03:13:34.822ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 30 table_name = measurements_u64
1772026-07-28T03:13:34.896ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
1782026-07-28T03:13:35.514ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
1792026-07-28T03:13:35.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1802026-07-28T03:13:35.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1812026-07-28T03:13:35.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1822026-07-28T03:13:36.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1832026-07-28T03:13:36.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1842026-07-28T03:13:36.725ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1852026-07-28T03:13:37.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1862026-07-28T03:13:37.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1872026-07-28T03:13:37.725ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1882026-07-28T03:13:38.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1892026-07-28T03:13:38.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1902026-07-28T03:13:38.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1912026-07-28T03:13:39.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1922026-07-28T03:13:39.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1932026-07-28T03:13:39.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1942026-07-28T03:13:39.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 132
1952026-07-28T03:13:39.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 132
1962026-07-28T03:13:39.795ZDEBGoximeter (clickhouse-client): unrolling 132 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
1972026-07-28T03:13:39.795ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
1982026-07-28T03:13:39.800ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 4 table_name = fields_ipaddr
1992026-07-28T03:13:39.801ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 52 table_name = fields_string
2002026-07-28T03:13:39.802ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 4 table_name = fields_u16
2012026-07-28T03:13:39.803ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 56 table_name = fields_uuid
2022026-07-28T03:13:39.805ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 102 table_name = measurements_cumulativeu64
2032026-07-28T03:13:39.806ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 30 table_name = measurements_u64
2042026-07-28T03:13:39.896ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2052026-07-28T03:13:40.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2062026-07-28T03:13:40.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2072026-07-28T03:13:40.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2082026-07-28T03:13:41.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2092026-07-28T03:13:41.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2102026-07-28T03:13:41.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2112026-07-28T03:13:42.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2122026-07-28T03:13:42.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2132026-07-28T03:13:42.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2142026-07-28T03:13:43.019ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
2152026-07-28T03:13:43.019ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
2162026-07-28T03:13:43.038ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 288 producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
2172026-07-28T03:13:43.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2182026-07-28T03:13:43.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2192026-07-28T03:13:43.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2202026-07-28T03:13:43.750ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
2212026-07-28T03:13:43.750ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
2222026-07-28T03:13:43.752ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
2232026-07-28T03:13:43.910ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
2242026-07-28T03:13:43.910ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?sort_by=id_ascending
2252026-07-28T03:13:43.913ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb7a2314-213e-4509-8fbe-94bb2e687b10", "content-length": "710", "date": "Tue, 28 Jul 2026 03:13:43 GMT"} })
2262026-07-28T03:13:43.913ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWUxYTBhZS1iN2ViLTRmNjYtYjQzZS1lNTUxODZkMWM4NTEifX0%3D
2272026-07-28T03:13:43.918ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWUxYTBhZS1iN2ViLTRmNjYtYjQzZS1lNTUxODZkMWM4NTEifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b0d2345-f079-453e-b7fc-d19d068dc214", "content-length": "29", "date": "Tue, 28 Jul 2026 03:13:43 GMT"} })
2282026-07-28T03:13:43.918ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:8001 collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db
2292026-07-28T03:13:43.918ZDEBGoximeter (oximeter-agent): received request to register existing metric producer, updating collection information address = [fd00:1122:3344:101::2]:39375 collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851
2302026-07-28T03:13:43.918ZDEBGoximeter (collection-task-handle): notified collection task of new producer endpoint collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
2312026-07-28T03:13:43.918ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 4 n_pruned_tasks = 0
2322026-07-28T03:13:43.918ZDEBGoximeter (collection-task): collection task received request to update its producer information address = [fd00:1122:3344:101::2]:39375 collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d interval = 10s producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
2332026-07-28T03:13:44.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2342026-07-28T03:13:44.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2352026-07-28T03:13:44.225ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2362026-07-28T03:13:44.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2372026-07-28T03:13:44.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2382026-07-28T03:13:44.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2392026-07-28T03:13:44.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 455
2402026-07-28T03:13:44.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 455
2412026-07-28T03:13:44.795ZDEBGoximeter (clickhouse-client): unrolling 455 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
2422026-07-28T03:13:44.796ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
2432026-07-28T03:13:44.800ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:44.795927893Z } timeseries_name = switch_port_control_data_link:bytes_received
2442026-07-28T03:13:44.800ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:44.795937293Z } timeseries_name = switch_port_control_data_link:bytes_sent
2452026-07-28T03:13:44.800ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:44.795917433Z } timeseries_name = switch_port_control_data_link:errors_received
2462026-07-28T03:13:44.800ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:44.795923123Z } timeseries_name = switch_port_control_data_link:errors_sent
2472026-07-28T03:13:44.800ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:44.795932763Z } timeseries_name = switch_port_control_data_link:packets_received
2482026-07-28T03:13:44.800ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:44.795942053Z } timeseries_name = switch_port_control_data_link:packets_sent
2492026-07-28T03:13:44.806ZDEBGoximeter (clickhouse-client): inserting 6 new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
2502026-07-28T03:13:44.810ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 24 table_name = fields_i16
2512026-07-28T03:13:44.811ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 242 table_name = fields_string
2522026-07-28T03:13:44.812ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 35 table_name = fields_u16
2532026-07-28T03:13:44.814ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 24 table_name = fields_u32
2542026-07-28T03:13:44.815ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 12 table_name = fields_u8
2552026-07-28T03:13:44.816ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 139 table_name = fields_uuid
2562026-07-28T03:13:44.818ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 398 table_name = measurements_cumulativeu64
2572026-07-28T03:13:44.820ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 23 table_name = measurements_histogramu64
2582026-07-28T03:13:44.821ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 34 table_name = measurements_u64
2592026-07-28T03:13:44.896ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2602026-07-28T03:13:45.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2612026-07-28T03:13:45.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2622026-07-28T03:13:45.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2632026-07-28T03:13:45.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2642026-07-28T03:13:45.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2652026-07-28T03:13:45.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2662026-07-28T03:13:46.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2672026-07-28T03:13:46.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2682026-07-28T03:13:46.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2692026-07-28T03:13:46.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2702026-07-28T03:13:46.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2712026-07-28T03:13:46.727ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2722026-07-28T03:13:47.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2732026-07-28T03:13:47.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2742026-07-28T03:13:47.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2752026-07-28T03:13:47.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2762026-07-28T03:13:47.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2772026-07-28T03:13:47.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2782026-07-28T03:13:48.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2792026-07-28T03:13:48.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2802026-07-28T03:13:48.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2812026-07-28T03:13:48.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2822026-07-28T03:13:48.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2832026-07-28T03:13:48.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2842026-07-28T03:13:49.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2852026-07-28T03:13:49.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2862026-07-28T03:13:49.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
2872026-07-28T03:13:49.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2882026-07-28T03:13:49.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2892026-07-28T03:13:49.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2902026-07-28T03:13:49.796ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 200
2912026-07-28T03:13:49.796ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 200
2922026-07-28T03:13:49.796ZDEBGoximeter (clickhouse-client): unrolling 200 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
2932026-07-28T03:13:49.796ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
2942026-07-28T03:13:49.802ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 76 table_name = fields_string
2952026-07-28T03:13:49.804ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 80 table_name = fields_uuid
2962026-07-28T03:13:49.806ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 150 table_name = measurements_cumulativeu64
2972026-07-28T03:13:49.808ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 50 table_name = measurements_u64
2982026-07-28T03:13:49.897ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
2992026-07-28T03:13:50.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3002026-07-28T03:13:50.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3012026-07-28T03:13:50.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3022026-07-28T03:13:50.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3032026-07-28T03:13:50.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3042026-07-28T03:13:50.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3052026-07-28T03:13:51.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3062026-07-28T03:13:51.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3072026-07-28T03:13:51.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3082026-07-28T03:13:51.324ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
3092026-07-28T03:13:51.324ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
3102026-07-28T03:13:51.344ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
3112026-07-28T03:13:51.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3122026-07-28T03:13:51.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3132026-07-28T03:13:51.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3142026-07-28T03:13:52.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3152026-07-28T03:13:52.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3162026-07-28T03:13:52.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3172026-07-28T03:13:52.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3182026-07-28T03:13:52.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3192026-07-28T03:13:52.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3202026-07-28T03:13:53.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3212026-07-28T03:13:53.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3222026-07-28T03:13:53.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3232026-07-28T03:13:53.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3242026-07-28T03:13:53.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3252026-07-28T03:13:53.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3262026-07-28T03:13:53.750ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
3272026-07-28T03:13:53.750ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
3282026-07-28T03:13:53.753ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
3292026-07-28T03:13:54.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3302026-07-28T03:13:54.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3312026-07-28T03:13:54.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3322026-07-28T03:13:54.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3332026-07-28T03:13:54.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3342026-07-28T03:13:54.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3352026-07-28T03:13:54.796ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 363
3362026-07-28T03:13:54.796ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 363
3372026-07-28T03:13:54.796ZDEBGoximeter (clickhouse-client): unrolling 363 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
3382026-07-28T03:13:54.796ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
3392026-07-28T03:13:54.799ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("dendrite:sample_collection_duration"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Metric, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Metric, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Metric, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:54.796272501Z } timeseries_name = dendrite:sample_collection_duration
3402026-07-28T03:13:54.799ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_enabled"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:54.796199929Z } timeseries_name = switch_data_link:link_enabled
3412026-07-28T03:13:54.799ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_data_link:link_up"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_id", field_type: U8, source: Metric, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "port_id", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: Bool, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:54.796204409Z } timeseries_name = switch_data_link:link_up
3422026-07-28T03:13:54.799ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:capacity"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:54.796209039Z } timeseries_name = switch_table:capacity
3432026-07-28T03:13:54.799ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:collisions"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:54.796224390Z } timeseries_name = switch_table:collisions
3442026-07-28T03:13:54.799ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:delete_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:54.796230730Z } timeseries_name = switch_table:delete_misses
3452026-07-28T03:13:54.799ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:deletes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:54.796218050Z } timeseries_name = switch_table:deletes
3462026-07-28T03:13:54.799ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:exhaustion"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:54.796233910Z } timeseries_name = switch_table:exhaustion
3472026-07-28T03:13:54.799ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:inserts"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:54.796214830Z } timeseries_name = switch_table:inserts
3482026-07-28T03:13:54.799ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:occupancy"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:54.796211599Z } timeseries_name = switch_table:occupancy
3492026-07-28T03:13:54.799ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:update_misses"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:54.796227920Z } timeseries_name = switch_table:update_misses
3502026-07-28T03:13:54.799ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_table:updates"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }, FieldSchema { name: "table", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:13:54.796220680Z } timeseries_name = switch_table:updates
3512026-07-28T03:13:54.802ZDEBGoximeter (clickhouse-client): inserting 12 new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
3522026-07-28T03:13:54.805ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 280 table_name = fields_i16
3532026-07-28T03:13:54.807ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 843 table_name = fields_string
3542026-07-28T03:13:54.808ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 163 table_name = fields_u16
3552026-07-28T03:13:54.809ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 145 table_name = fields_u32
3562026-07-28T03:13:54.811ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 144 table_name = fields_u8
3572026-07-28T03:13:54.812ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 523 table_name = fields_uuid
3582026-07-28T03:13:54.813ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 4 table_name = measurements_bool
3592026-07-28T03:13:54.815ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 255 table_name = measurements_cumulativeu64
3602026-07-28T03:13:54.816ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 1 table_name = measurements_f64
3612026-07-28T03:13:54.818ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 23 table_name = measurements_histogramu64
3622026-07-28T03:13:54.819ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 80 table_name = measurements_u64
3632026-07-28T03:13:54.897ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
3642026-07-28T03:13:55.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3652026-07-28T03:13:55.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3662026-07-28T03:13:55.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3672026-07-28T03:13:55.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3682026-07-28T03:13:55.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3692026-07-28T03:13:55.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3702026-07-28T03:13:56.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3712026-07-28T03:13:56.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3722026-07-28T03:13:56.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3732026-07-28T03:13:56.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3742026-07-28T03:13:56.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3752026-07-28T03:13:56.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3762026-07-28T03:13:57.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3772026-07-28T03:13:57.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3782026-07-28T03:13:57.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3792026-07-28T03:13:57.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3802026-07-28T03:13:57.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3812026-07-28T03:13:57.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3822026-07-28T03:13:58.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3832026-07-28T03:13:58.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3842026-07-28T03:13:58.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3852026-07-28T03:13:58.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3862026-07-28T03:13:58.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3872026-07-28T03:13:58.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3882026-07-28T03:13:58.911ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
3892026-07-28T03:13:58.911ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?sort_by=id_ascending
3902026-07-28T03:13:59.010ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0978a3d-f161-4a2e-ac58-4c2a9426ca12", "content-length": "851", "date": "Tue, 28 Jul 2026 03:13:59 GMT"} })
3912026-07-28T03:13:59.010ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWUxYTBhZS1iN2ViLTRmNjYtYjQzZS1lNTUxODZkMWM4NTEifX0%3D
3922026-07-28T03:13:59.013ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWUxYTBhZS1iN2ViLTRmNjYtYjQzZS1lNTUxODZkMWM4NTEifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab3ad371-e938-4554-aedf-a6ed1d8b62af", "content-length": "29", "date": "Tue, 28 Jul 2026 03:13:59 GMT"} })
3932026-07-28T03:13:59.013ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:58804 collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 005b0d90-8ee7-46fb-8ea6-4da97fb0b10c
3942026-07-28T03:13:59.013ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 5 n_pruned_tasks = 0
3952026-07-28T03:13:59.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3962026-07-28T03:13:59.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3972026-07-28T03:13:59.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
3982026-07-28T03:13:59.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3992026-07-28T03:13:59.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4002026-07-28T03:13:59.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4012026-07-28T03:13:59.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 204
4022026-07-28T03:13:59.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 204
4032026-07-28T03:13:59.795ZDEBGoximeter (clickhouse-client): unrolling 204 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
4042026-07-28T03:13:59.795ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
4052026-07-28T03:13:59.800ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 4 table_name = fields_ipaddr
4062026-07-28T03:13:59.801ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 80 table_name = fields_string
4072026-07-28T03:13:59.802ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 4 table_name = fields_u16
4082026-07-28T03:13:59.804ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 84 table_name = fields_uuid
4092026-07-28T03:13:59.805ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 152 table_name = measurements_cumulativeu64
4102026-07-28T03:13:59.807ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 2 table_name = measurements_histogramu64
4112026-07-28T03:13:59.808ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 50 table_name = measurements_u64
4122026-07-28T03:13:59.896ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
4132026-07-28T03:14:00.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4142026-07-28T03:14:00.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4152026-07-28T03:14:00.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4162026-07-28T03:14:00.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4172026-07-28T03:14:00.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4182026-07-28T03:14:00.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4192026-07-28T03:14:01.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4202026-07-28T03:14:01.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4212026-07-28T03:14:01.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4222026-07-28T03:14:01.323ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
4232026-07-28T03:14:01.323ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
4242026-07-28T03:14:01.335ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
4252026-07-28T03:14:01.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4262026-07-28T03:14:01.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4272026-07-28T03:14:01.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4282026-07-28T03:14:02.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4292026-07-28T03:14:02.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4302026-07-28T03:14:02.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4312026-07-28T03:14:02.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4322026-07-28T03:14:02.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4332026-07-28T03:14:02.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4342026-07-28T03:14:03.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4352026-07-28T03:14:03.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4362026-07-28T03:14:03.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4372026-07-28T03:14:03.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4382026-07-28T03:14:03.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4392026-07-28T03:14:03.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4402026-07-28T03:14:03.751ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
4412026-07-28T03:14:03.751ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
4422026-07-28T03:14:03.753ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
4432026-07-28T03:14:04.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4442026-07-28T03:14:04.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4452026-07-28T03:14:04.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4462026-07-28T03:14:04.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4472026-07-28T03:14:04.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4482026-07-28T03:14:04.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4492026-07-28T03:14:04.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 363
4502026-07-28T03:14:04.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 363
4512026-07-28T03:14:04.795ZDEBGoximeter (clickhouse-client): unrolling 363 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
4522026-07-28T03:14:04.795ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
4532026-07-28T03:14:04.805ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 280 table_name = fields_i16
4542026-07-28T03:14:04.807ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 843 table_name = fields_string
4552026-07-28T03:14:04.808ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 163 table_name = fields_u16
4562026-07-28T03:14:04.810ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 145 table_name = fields_u32
4572026-07-28T03:14:04.811ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 144 table_name = fields_u8
4582026-07-28T03:14:04.812ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 523 table_name = fields_uuid
4592026-07-28T03:14:04.813ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 4 table_name = measurements_bool
4602026-07-28T03:14:04.815ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 255 table_name = measurements_cumulativeu64
4612026-07-28T03:14:04.816ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 1 table_name = measurements_f64
4622026-07-28T03:14:04.817ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 23 table_name = measurements_histogramu64
4632026-07-28T03:14:04.819ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 80 table_name = measurements_u64
4642026-07-28T03:14:04.896ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
4652026-07-28T03:14:05.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4662026-07-28T03:14:05.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4672026-07-28T03:14:05.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4682026-07-28T03:14:05.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4692026-07-28T03:14:05.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4702026-07-28T03:14:05.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4712026-07-28T03:14:06.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4722026-07-28T03:14:06.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4732026-07-28T03:14:06.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4742026-07-28T03:14:06.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4752026-07-28T03:14:06.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4762026-07-28T03:14:06.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4772026-07-28T03:14:07.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4782026-07-28T03:14:07.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4792026-07-28T03:14:07.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4802026-07-28T03:14:07.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4812026-07-28T03:14:07.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4822026-07-28T03:14:07.725ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4832026-07-28T03:14:08.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4842026-07-28T03:14:08.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4852026-07-28T03:14:08.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4862026-07-28T03:14:08.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4872026-07-28T03:14:08.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4882026-07-28T03:14:08.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4892026-07-28T03:14:09.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4902026-07-28T03:14:09.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4912026-07-28T03:14:09.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
4922026-07-28T03:14:09.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4932026-07-28T03:14:09.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4942026-07-28T03:14:09.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4952026-07-28T03:14:09.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 200
4962026-07-28T03:14:09.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 200
4972026-07-28T03:14:09.795ZDEBGoximeter (clickhouse-client): unrolling 200 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
4982026-07-28T03:14:09.795ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
4992026-07-28T03:14:09.800ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 76 table_name = fields_string
5002026-07-28T03:14:09.801ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 80 table_name = fields_uuid
5012026-07-28T03:14:09.802ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 150 table_name = measurements_cumulativeu64
5022026-07-28T03:14:09.804ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 50 table_name = measurements_u64
5032026-07-28T03:14:09.897ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
5042026-07-28T03:14:10.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5052026-07-28T03:14:10.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5062026-07-28T03:14:10.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5072026-07-28T03:14:10.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5082026-07-28T03:14:10.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5092026-07-28T03:14:10.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5102026-07-28T03:14:11.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5112026-07-28T03:14:11.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5122026-07-28T03:14:11.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5132026-07-28T03:14:11.323ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
5142026-07-28T03:14:11.323ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
5152026-07-28T03:14:11.332ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
5162026-07-28T03:14:11.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5172026-07-28T03:14:11.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5182026-07-28T03:14:11.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5192026-07-28T03:14:12.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5202026-07-28T03:14:12.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5212026-07-28T03:14:12.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5222026-07-28T03:14:12.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5232026-07-28T03:14:12.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5242026-07-28T03:14:12.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5252026-07-28T03:14:13.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5262026-07-28T03:14:13.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5272026-07-28T03:14:13.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5282026-07-28T03:14:13.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5292026-07-28T03:14:13.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5302026-07-28T03:14:13.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5312026-07-28T03:14:13.750ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
5322026-07-28T03:14:13.750ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
5332026-07-28T03:14:13.752ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
5342026-07-28T03:14:13.910ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
5352026-07-28T03:14:13.911ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?sort_by=id_ascending
5362026-07-28T03:14:13.915ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9f6e601-9265-4293-813c-2d29e8465f5a", "content-length": "1412", "date": "Tue, 28 Jul 2026 03:14:13 GMT"} })
5372026-07-28T03:14:13.915ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWUxYTBhZS1iN2ViLTRmNjYtYjQzZS1lNTUxODZkMWM4NTEifX0%3D
5382026-07-28T03:14:13.919ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWUxYTBhZS1iN2ViLTRmNjYtYjQzZS1lNTUxODZkMWM4NTEifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "96ef6400-fd83-4e38-ab9b-53a2f1978495", "content-length": "29", "date": "Tue, 28 Jul 2026 03:14:13 GMT"} })
5392026-07-28T03:14:13.919ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:4677 collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef
5402026-07-28T03:14:13.919ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:64820 collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 7473a1f5-c4c3-4a98-8d98-9b15d53f59b1
5412026-07-28T03:14:13.919ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::b]:51130 collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = bd69b1dd-776c-498f-a1ad-4e3f287c7d83
5422026-07-28T03:14:13.919ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::c]:42397 collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = dca87a9a-e9f0-4227-9ca8-edb4b534193e
5432026-07-28T03:14:13.919ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 9 n_pruned_tasks = 0
5442026-07-28T03:14:14.172ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5452026-07-28T03:14:14.172ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5462026-07-28T03:14:14.179ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5472026-07-28T03:14:14.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5482026-07-28T03:14:14.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5492026-07-28T03:14:14.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5502026-07-28T03:14:14.385ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = bd69b1dd-776c-498f-a1ad-4e3f287c7d83 producer_ip = fd00:1122:3344:101::b producer_port = 51130
5512026-07-28T03:14:14.385ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = bd69b1dd-776c-498f-a1ad-4e3f287c7d83 producer_ip = fd00:1122:3344:101::b producer_port = 51130
5522026-07-28T03:14:14.394ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 11 producer_id = bd69b1dd-776c-498f-a1ad-4e3f287c7d83 producer_ip = fd00:1122:3344:101::b producer_port = 51130
5532026-07-28T03:14:14.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5542026-07-28T03:14:14.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5552026-07-28T03:14:14.727ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5562026-07-28T03:14:14.796ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 378
5572026-07-28T03:14:14.796ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 378
5582026-07-28T03:14:14.796ZDEBGoximeter (clickhouse-client): unrolling 378 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
5592026-07-28T03:14:14.796ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
5602026-07-28T03:14:14.800ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("database_transaction:retry_data"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "attempt", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "name", field_type: String, source: Target, description: "" }}, datum_type: F64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:14:14.796858708Z } timeseries_name = database_transaction:retry_data
5612026-07-28T03:14:14.800ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("mg_lower:routes_blocked_by_link_state"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:14:14.796841748Z } timeseries_name = mg_lower:routes_blocked_by_link_state
5622026-07-28T03:14:14.800ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_nexthops"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:14:14.796837328Z } timeseries_name = static_routing_config:static_nexthops
5632026-07-28T03:14:14.800ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("static_routing_config:static_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:14:14.796834798Z } timeseries_name = static_routing_config:static_routes
5642026-07-28T03:14:14.800ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_rib:active_routes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:14:14.796839468Z } timeseries_name = switch_rib:active_routes
5652026-07-28T03:14:14.804ZDEBGoximeter (clickhouse-client): inserting 5 new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
5662026-07-28T03:14:14.807ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 280 table_name = fields_i16
5672026-07-28T03:14:14.809ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 856 table_name = fields_string
5682026-07-28T03:14:14.810ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 167 table_name = fields_u16
5692026-07-28T03:14:14.811ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 146 table_name = fields_u32
5702026-07-28T03:14:14.813ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 144 table_name = fields_u8
5712026-07-28T03:14:14.814ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 541 table_name = fields_uuid
5722026-07-28T03:14:14.815ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 4 table_name = measurements_bool
5732026-07-28T03:14:14.816ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 257 table_name = measurements_cumulativeu64
5742026-07-28T03:14:14.818ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 2 table_name = measurements_f64
5752026-07-28T03:14:14.819ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 27 table_name = measurements_histogramu64
5762026-07-28T03:14:14.820ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 6 table_name = measurements_i64
5772026-07-28T03:14:14.822ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 82 table_name = measurements_u64
5782026-07-28T03:14:14.897ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
5792026-07-28T03:14:15.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5802026-07-28T03:14:15.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5812026-07-28T03:14:15.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5822026-07-28T03:14:15.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5832026-07-28T03:14:15.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5842026-07-28T03:14:15.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5852026-07-28T03:14:15.409ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
5862026-07-28T03:14:15.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5872026-07-28T03:14:15.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5882026-07-28T03:14:15.727ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5892026-07-28T03:14:16.172ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5902026-07-28T03:14:16.172ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5912026-07-28T03:14:16.173ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
5922026-07-28T03:14:16.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5932026-07-28T03:14:16.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5942026-07-28T03:14:16.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
5952026-07-28T03:14:16.275ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = dca87a9a-e9f0-4227-9ca8-edb4b534193e producer_ip = fd00:1122:3344:101::c producer_port = 42397
5962026-07-28T03:14:16.275ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = dca87a9a-e9f0-4227-9ca8-edb4b534193e producer_ip = fd00:1122:3344:101::c producer_port = 42397
5972026-07-28T03:14:16.285ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 7 producer_id = dca87a9a-e9f0-4227-9ca8-edb4b534193e producer_ip = fd00:1122:3344:101::c producer_port = 42397
5982026-07-28T03:14:16.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
5992026-07-28T03:14:16.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6002026-07-28T03:14:16.725ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6012026-07-28T03:14:17.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6022026-07-28T03:14:17.172ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6032026-07-28T03:14:17.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6042026-07-28T03:14:17.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6052026-07-28T03:14:17.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6062026-07-28T03:14:17.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6072026-07-28T03:14:17.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6082026-07-28T03:14:17.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6092026-07-28T03:14:17.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6102026-07-28T03:14:18.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6112026-07-28T03:14:18.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6122026-07-28T03:14:18.171ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6132026-07-28T03:14:18.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6142026-07-28T03:14:18.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6152026-07-28T03:14:18.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6162026-07-28T03:14:18.413ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 7473a1f5-c4c3-4a98-8d98-9b15d53f59b1 producer_ip = fd00:1122:3344:101::2 producer_port = 64820
6172026-07-28T03:14:18.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6182026-07-28T03:14:18.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6192026-07-28T03:14:18.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6202026-07-28T03:14:19.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6212026-07-28T03:14:19.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6222026-07-28T03:14:19.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6232026-07-28T03:14:19.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6242026-07-28T03:14:19.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6252026-07-28T03:14:19.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6262026-07-28T03:14:19.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6272026-07-28T03:14:19.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6282026-07-28T03:14:19.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6292026-07-28T03:14:19.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 231
6302026-07-28T03:14:19.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 231
6312026-07-28T03:14:19.795ZDEBGoximeter (clickhouse-client): unrolling 231 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
6322026-07-28T03:14:19.795ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
6332026-07-28T03:14:19.800ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 8 table_name = fields_ipaddr
6342026-07-28T03:14:19.802ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 91 table_name = fields_string
6352026-07-28T03:14:19.803ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 11 table_name = fields_u16
6362026-07-28T03:14:19.804ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 1 table_name = fields_u32
6372026-07-28T03:14:19.805ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 102 table_name = fields_uuid
6382026-07-28T03:14:19.806ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 164 table_name = measurements_cumulativeu64
6392026-07-28T03:14:19.808ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 1 table_name = measurements_f64
6402026-07-28T03:14:19.809ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 3 table_name = measurements_histogramu64
6412026-07-28T03:14:19.810ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 3 table_name = measurements_i64
6422026-07-28T03:14:19.811ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 60 table_name = measurements_u64
6432026-07-28T03:14:19.896ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
6442026-07-28T03:14:20.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6452026-07-28T03:14:20.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6462026-07-28T03:14:20.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6472026-07-28T03:14:20.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6482026-07-28T03:14:20.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6492026-07-28T03:14:20.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6502026-07-28T03:14:20.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6512026-07-28T03:14:20.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6522026-07-28T03:14:20.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6532026-07-28T03:14:21.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6542026-07-28T03:14:21.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6552026-07-28T03:14:21.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6562026-07-28T03:14:21.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6572026-07-28T03:14:21.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6582026-07-28T03:14:21.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6592026-07-28T03:14:21.233ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 7473a1f5-c4c3-4a98-8d98-9b15d53f59b1 producer_ip = fd00:1122:3344:101::2 producer_port = 64820
6602026-07-28T03:14:21.233ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 7473a1f5-c4c3-4a98-8d98-9b15d53f59b1 producer_ip = fd00:1122:3344:101::2 producer_port = 64820
6612026-07-28T03:14:21.243ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 7473a1f5-c4c3-4a98-8d98-9b15d53f59b1 producer_ip = fd00:1122:3344:101::2 producer_port = 64820
6622026-07-28T03:14:21.323ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
6632026-07-28T03:14:21.323ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
6642026-07-28T03:14:21.330ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
6652026-07-28T03:14:21.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6662026-07-28T03:14:21.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6672026-07-28T03:14:21.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6682026-07-28T03:14:22.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6692026-07-28T03:14:22.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6702026-07-28T03:14:22.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6712026-07-28T03:14:22.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6722026-07-28T03:14:22.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6732026-07-28T03:14:22.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6742026-07-28T03:14:22.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6752026-07-28T03:14:22.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6762026-07-28T03:14:22.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6772026-07-28T03:14:23.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6782026-07-28T03:14:23.172ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6792026-07-28T03:14:23.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6802026-07-28T03:14:23.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6812026-07-28T03:14:23.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6822026-07-28T03:14:23.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6832026-07-28T03:14:23.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6842026-07-28T03:14:23.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6852026-07-28T03:14:23.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6862026-07-28T03:14:23.751ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
6872026-07-28T03:14:23.751ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
6882026-07-28T03:14:23.753ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
6892026-07-28T03:14:24.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6902026-07-28T03:14:24.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6912026-07-28T03:14:24.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
6922026-07-28T03:14:24.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6932026-07-28T03:14:24.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6942026-07-28T03:14:24.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
6952026-07-28T03:14:24.385ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = bd69b1dd-776c-498f-a1ad-4e3f287c7d83 producer_ip = fd00:1122:3344:101::b producer_port = 51130
6962026-07-28T03:14:24.385ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = bd69b1dd-776c-498f-a1ad-4e3f287c7d83 producer_ip = fd00:1122:3344:101::b producer_port = 51130
6972026-07-28T03:14:24.386ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 4 producer_id = bd69b1dd-776c-498f-a1ad-4e3f287c7d83 producer_ip = fd00:1122:3344:101::b producer_port = 51130
6982026-07-28T03:14:24.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
6992026-07-28T03:14:24.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7002026-07-28T03:14:24.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7012026-07-28T03:14:24.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 398
7022026-07-28T03:14:24.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 398
7032026-07-28T03:14:24.795ZDEBGoximeter (clickhouse-client): unrolling 398 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
7042026-07-28T03:14:24.796ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
7052026-07-28T03:14:24.804ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 280 table_name = fields_i16
7062026-07-28T03:14:24.806ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 877 table_name = fields_string
7072026-07-28T03:14:24.807ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 178 table_name = fields_u16
7082026-07-28T03:14:24.808ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 145 table_name = fields_u32
7092026-07-28T03:14:24.810ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 144 table_name = fields_u8
7102026-07-28T03:14:24.811ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 546 table_name = fields_uuid
7112026-07-28T03:14:24.812ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 4 table_name = measurements_bool
7122026-07-28T03:14:24.814ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 265 table_name = measurements_cumulativeu64
7132026-07-28T03:14:24.815ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 1 table_name = measurements_f64
7142026-07-28T03:14:24.816ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 005b0d90-8ee7-46fb-8ea6-4da97fb0b10c producer_ip = fd00:1122:3344:101::1 producer_port = 58804
7152026-07-28T03:14:24.816ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 005b0d90-8ee7-46fb-8ea6-4da97fb0b10c producer_ip = fd00:1122:3344:101::1 producer_port = 58804
7162026-07-28T03:14:24.817ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 38 table_name = measurements_histogramu64
7172026-07-28T03:14:24.818ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 90 table_name = measurements_u64
7182026-07-28T03:14:24.897ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
7192026-07-28T03:14:24.984ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 9086 producer_id = 005b0d90-8ee7-46fb-8ea6-4da97fb0b10c producer_ip = fd00:1122:3344:101::1 producer_port = 58804
7202026-07-28T03:14:25.035ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 9086
7212026-07-28T03:14:25.035ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 9086
7222026-07-28T03:14:25.035ZDEBGoximeter (clickhouse-client): unrolling 9086 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
7232026-07-28T03:14:25.036ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
7242026-07-28T03:14:25.039ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("kstat_sampler:expired_targets"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:14:25.036710203Z } timeseries_name = kstat_sampler:expired_targets
7252026-07-28T03:14:25.039ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_cpu:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "cpu_id", field_type: U32, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:14:25.036215010Z } timeseries_name = sled_cpu:cpu_nsec
7262026-07-28T03:14:25.039ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:14:25.035519581Z } timeseries_name = sled_data_link:bytes_received
7272026-07-28T03:14:25.039ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:14:25.035523931Z } timeseries_name = sled_data_link:bytes_sent
7282026-07-28T03:14:25.039ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:14:25.035513361Z } timeseries_name = sled_data_link:errors_received
7292026-07-28T03:14:25.039ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:14:25.035517341Z } timeseries_name = sled_data_link:errors_sent
7302026-07-28T03:14:25.039ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:14:25.035521941Z } timeseries_name = sled_data_link:packets_received
7312026-07-28T03:14:25.039ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("sled_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:14:25.035526061Z } timeseries_name = sled_data_link:packets_sent
7322026-07-28T03:14:25.039ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_dataset:bytes_used"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "dataset_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "dataset_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "dataset_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:14:25.036732274Z } timeseries_name = zfs_dataset:bytes_used
7332026-07-28T03:14:25.039ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_pool:bytes_allocated"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:14:25.036719403Z } timeseries_name = zfs_pool:bytes_allocated
7342026-07-28T03:14:25.039ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zfs_pool:bytes_total"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "pool_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "pool_kind", field_type: String, source: Metric, description: "" }, FieldSchema { name: "pool_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:14:25.036722743Z } timeseries_name = zfs_pool:bytes_total
7352026-07-28T03:14:25.039ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 schema = TimeseriesSchema { timeseries_name: TimeseriesName("zone:cpu_nsec"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "state", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "zone_name", field_type: String, source: Metric, description: "" }, FieldSchema { name: "zone_type", field_type: String, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-07-28T03:14:25.035870431Z } timeseries_name = zone:cpu_nsec
7362026-07-28T03:14:25.079ZDEBGoximeter (clickhouse-client): inserting 12 new timeseries schema collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
7372026-07-28T03:14:25.084ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 3208 table_name = fields_string
7382026-07-28T03:14:25.085ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 11 table_name = fields_u16
7392026-07-28T03:14:25.086ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 953 table_name = fields_u32
7402026-07-28T03:14:25.089ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 1808 table_name = fields_uuid
7412026-07-28T03:14:25.094ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 8467 table_name = measurements_cumulativeu64
7422026-07-28T03:14:25.096ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 11 table_name = measurements_histogramu64
7432026-07-28T03:14:25.098ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 608 table_name = measurements_u64
7442026-07-28T03:14:25.136ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
7452026-07-28T03:14:25.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7462026-07-28T03:14:25.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7472026-07-28T03:14:25.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7482026-07-28T03:14:25.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7492026-07-28T03:14:25.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7502026-07-28T03:14:25.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7512026-07-28T03:14:25.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7522026-07-28T03:14:25.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7532026-07-28T03:14:25.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7542026-07-28T03:14:25.812ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 005b0d90-8ee7-46fb-8ea6-4da97fb0b10c producer_ip = fd00:1122:3344:101::1 producer_port = 58804
7552026-07-28T03:14:26.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7562026-07-28T03:14:26.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7572026-07-28T03:14:26.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7582026-07-28T03:14:26.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7592026-07-28T03:14:26.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7602026-07-28T03:14:26.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7612026-07-28T03:14:26.275ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = dca87a9a-e9f0-4227-9ca8-edb4b534193e producer_ip = fd00:1122:3344:101::c producer_port = 42397
7622026-07-28T03:14:26.275ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = dca87a9a-e9f0-4227-9ca8-edb4b534193e producer_ip = fd00:1122:3344:101::c producer_port = 42397
7632026-07-28T03:14:26.276ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = dca87a9a-e9f0-4227-9ca8-edb4b534193e producer_ip = fd00:1122:3344:101::c producer_port = 42397
7642026-07-28T03:14:26.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7652026-07-28T03:14:26.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7662026-07-28T03:14:26.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7672026-07-28T03:14:27.172ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7682026-07-28T03:14:27.172ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7692026-07-28T03:14:27.173ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7702026-07-28T03:14:27.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7712026-07-28T03:14:27.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7722026-07-28T03:14:27.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7732026-07-28T03:14:27.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7742026-07-28T03:14:27.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7752026-07-28T03:14:27.727ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7762026-07-28T03:14:28.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7772026-07-28T03:14:28.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7782026-07-28T03:14:28.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7792026-07-28T03:14:28.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7802026-07-28T03:14:28.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7812026-07-28T03:14:28.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7822026-07-28T03:14:28.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7832026-07-28T03:14:28.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7842026-07-28T03:14:28.727ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7852026-07-28T03:14:28.911ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
7862026-07-28T03:14:28.911ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?sort_by=id_ascending
7872026-07-28T03:14:28.916ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f12ab02-1eaf-4302-a2cb-1c26c31a3e16", "content-length": "1412", "date": "Tue, 28 Jul 2026 03:14:28 GMT"} })
7882026-07-28T03:14:28.916ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWUxYTBhZS1iN2ViLTRmNjYtYjQzZS1lNTUxODZkMWM4NTEifX0%3D
7892026-07-28T03:14:28.919ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWUxYTBhZS1iN2ViLTRmNjYtYjQzZS1lNTUxODZkMWM4NTEifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0c57f01-e418-47cf-99d7-323b5869fa45", "content-length": "29", "date": "Tue, 28 Jul 2026 03:14:28 GMT"} })
7902026-07-28T03:14:28.919ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 9 n_pruned_tasks = 0
7912026-07-28T03:14:29.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7922026-07-28T03:14:29.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7932026-07-28T03:14:29.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
7942026-07-28T03:14:29.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7952026-07-28T03:14:29.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7962026-07-28T03:14:29.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
7972026-07-28T03:14:29.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7982026-07-28T03:14:29.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
7992026-07-28T03:14:29.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8002026-07-28T03:14:29.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 225
8012026-07-28T03:14:29.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 225
8022026-07-28T03:14:29.795ZDEBGoximeter (clickhouse-client): unrolling 225 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
8032026-07-28T03:14:29.796ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
8042026-07-28T03:14:29.801ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 4 table_name = fields_ipaddr
8052026-07-28T03:14:29.802ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 88 table_name = fields_string
8062026-07-28T03:14:29.803ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 7 table_name = fields_u16
8072026-07-28T03:14:29.804ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 95 table_name = fields_uuid
8082026-07-28T03:14:29.805ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 162 table_name = measurements_cumulativeu64
8092026-07-28T03:14:29.807ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 3 table_name = measurements_histogramu64
8102026-07-28T03:14:29.808ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 60 table_name = measurements_u64
8112026-07-28T03:14:29.897ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
8122026-07-28T03:14:30.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8132026-07-28T03:14:30.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8142026-07-28T03:14:30.171ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8152026-07-28T03:14:30.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8162026-07-28T03:14:30.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8172026-07-28T03:14:30.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8182026-07-28T03:14:30.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8192026-07-28T03:14:30.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8202026-07-28T03:14:30.725ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8212026-07-28T03:14:31.140ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8222026-07-28T03:14:31.172ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8232026-07-28T03:14:31.172ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8242026-07-28T03:14:31.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8252026-07-28T03:14:31.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8262026-07-28T03:14:31.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8272026-07-28T03:14:31.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8282026-07-28T03:14:31.233ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 7473a1f5-c4c3-4a98-8d98-9b15d53f59b1 producer_ip = fd00:1122:3344:101::2 producer_port = 64820
8292026-07-28T03:14:31.233ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 7473a1f5-c4c3-4a98-8d98-9b15d53f59b1 producer_ip = fd00:1122:3344:101::2 producer_port = 64820
8302026-07-28T03:14:31.236ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 7473a1f5-c4c3-4a98-8d98-9b15d53f59b1 producer_ip = fd00:1122:3344:101::2 producer_port = 64820
8312026-07-28T03:14:31.323ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
8322026-07-28T03:14:31.323ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
8332026-07-28T03:14:31.332ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
8342026-07-28T03:14:31.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8352026-07-28T03:14:31.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8362026-07-28T03:14:31.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8372026-07-28T03:14:31.847ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = dca87a9a-e9f0-4227-9ca8-edb4b534193e producer_ip = fd00:1122:3344:101::c producer_port = 42397
8382026-07-28T03:14:32.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8392026-07-28T03:14:32.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8402026-07-28T03:14:32.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8412026-07-28T03:14:32.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8422026-07-28T03:14:32.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8432026-07-28T03:14:32.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8442026-07-28T03:14:32.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8452026-07-28T03:14:32.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8462026-07-28T03:14:32.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8472026-07-28T03:14:33.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8482026-07-28T03:14:33.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8492026-07-28T03:14:33.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8502026-07-28T03:14:33.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8512026-07-28T03:14:33.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8522026-07-28T03:14:33.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8532026-07-28T03:14:33.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8542026-07-28T03:14:33.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8552026-07-28T03:14:33.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8562026-07-28T03:14:33.750ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
8572026-07-28T03:14:33.750ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
8582026-07-28T03:14:33.752ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
8592026-07-28T03:14:34.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8602026-07-28T03:14:34.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8612026-07-28T03:14:34.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8622026-07-28T03:14:34.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8632026-07-28T03:14:34.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8642026-07-28T03:14:34.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8652026-07-28T03:14:34.385ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = bd69b1dd-776c-498f-a1ad-4e3f287c7d83 producer_ip = fd00:1122:3344:101::b producer_port = 51130
8662026-07-28T03:14:34.385ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = bd69b1dd-776c-498f-a1ad-4e3f287c7d83 producer_ip = fd00:1122:3344:101::b producer_port = 51130
8672026-07-28T03:14:34.386ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 4 producer_id = bd69b1dd-776c-498f-a1ad-4e3f287c7d83 producer_ip = fd00:1122:3344:101::b producer_port = 51130
8682026-07-28T03:14:34.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8692026-07-28T03:14:34.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8702026-07-28T03:14:34.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8712026-07-28T03:14:34.796ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 402
8722026-07-28T03:14:34.796ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 402
8732026-07-28T03:14:34.796ZDEBGoximeter (clickhouse-client): unrolling 402 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
8742026-07-28T03:14:34.796ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
8752026-07-28T03:14:34.805ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 280 table_name = fields_i16
8762026-07-28T03:14:34.806ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 8 table_name = fields_ipaddr
8772026-07-28T03:14:34.808ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 881 table_name = fields_string
8782026-07-28T03:14:34.809ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 186 table_name = fields_u16
8792026-07-28T03:14:34.811ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 145 table_name = fields_u32
8802026-07-28T03:14:34.812ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 144 table_name = fields_u8
8812026-07-28T03:14:34.814ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 554 table_name = fields_uuid
8822026-07-28T03:14:34.815ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 4 table_name = measurements_bool
8832026-07-28T03:14:34.816ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 269 table_name = measurements_cumulativeu64
8842026-07-28T03:14:34.817ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 1 table_name = measurements_f64
8852026-07-28T03:14:34.819ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 38 table_name = measurements_histogramu64
8862026-07-28T03:14:34.820ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 90 table_name = measurements_u64
8872026-07-28T03:14:34.898ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
8882026-07-28T03:14:35.172ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8892026-07-28T03:14:35.172ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8902026-07-28T03:14:35.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8912026-07-28T03:14:35.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8922026-07-28T03:14:35.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8932026-07-28T03:14:35.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
8942026-07-28T03:14:35.515ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
8952026-07-28T03:14:35.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8962026-07-28T03:14:35.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8972026-07-28T03:14:35.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
8982026-07-28T03:14:36.172ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
8992026-07-28T03:14:36.172ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9002026-07-28T03:14:36.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9012026-07-28T03:14:36.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9022026-07-28T03:14:36.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9032026-07-28T03:14:36.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9042026-07-28T03:14:36.276ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = dca87a9a-e9f0-4227-9ca8-edb4b534193e producer_ip = fd00:1122:3344:101::c producer_port = 42397
9052026-07-28T03:14:36.276ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = dca87a9a-e9f0-4227-9ca8-edb4b534193e producer_ip = fd00:1122:3344:101::c producer_port = 42397
9062026-07-28T03:14:36.276ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = dca87a9a-e9f0-4227-9ca8-edb4b534193e producer_ip = fd00:1122:3344:101::c producer_port = 42397
9072026-07-28T03:14:36.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9082026-07-28T03:14:36.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9092026-07-28T03:14:36.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9102026-07-28T03:14:37.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9112026-07-28T03:14:37.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9122026-07-28T03:14:37.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9132026-07-28T03:14:37.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9142026-07-28T03:14:37.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9152026-07-28T03:14:37.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9162026-07-28T03:14:37.560ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9172026-07-28T03:14:37.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9182026-07-28T03:14:37.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9192026-07-28T03:14:37.725ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9202026-07-28T03:14:38.172ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9212026-07-28T03:14:38.172ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9222026-07-28T03:14:38.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9232026-07-28T03:14:38.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9242026-07-28T03:14:38.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9252026-07-28T03:14:38.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9262026-07-28T03:14:38.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9272026-07-28T03:14:38.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9282026-07-28T03:14:38.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9292026-07-28T03:14:39.172ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9302026-07-28T03:14:39.172ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9312026-07-28T03:14:39.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9322026-07-28T03:14:39.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9332026-07-28T03:14:39.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9342026-07-28T03:14:39.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9352026-07-28T03:14:39.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9362026-07-28T03:14:39.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9372026-07-28T03:14:39.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9382026-07-28T03:14:39.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 227
9392026-07-28T03:14:39.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 227
9402026-07-28T03:14:39.795ZDEBGoximeter (clickhouse-client): unrolling 227 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
9412026-07-28T03:14:39.795ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
9422026-07-28T03:14:39.801ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 8 table_name = fields_ipaddr
9432026-07-28T03:14:39.802ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 90 table_name = fields_string
9442026-07-28T03:14:39.804ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 11 table_name = fields_u16
9452026-07-28T03:14:39.805ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 99 table_name = fields_uuid
9462026-07-28T03:14:39.806ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 164 table_name = measurements_cumulativeu64
9472026-07-28T03:14:39.808ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 3 table_name = measurements_histogramu64
9482026-07-28T03:14:39.809ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 60 table_name = measurements_u64
9492026-07-28T03:14:39.897ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
9502026-07-28T03:14:40.172ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9512026-07-28T03:14:40.172ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9522026-07-28T03:14:40.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9532026-07-28T03:14:40.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9542026-07-28T03:14:40.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9552026-07-28T03:14:40.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9562026-07-28T03:14:40.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9572026-07-28T03:14:40.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9582026-07-28T03:14:40.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9592026-07-28T03:14:41.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9602026-07-28T03:14:41.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9612026-07-28T03:14:41.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9622026-07-28T03:14:41.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9632026-07-28T03:14:41.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9642026-07-28T03:14:41.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9652026-07-28T03:14:41.233ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 7473a1f5-c4c3-4a98-8d98-9b15d53f59b1 producer_ip = fd00:1122:3344:101::2 producer_port = 64820
9662026-07-28T03:14:41.233ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 7473a1f5-c4c3-4a98-8d98-9b15d53f59b1 producer_ip = fd00:1122:3344:101::2 producer_port = 64820
9672026-07-28T03:14:41.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 7473a1f5-c4c3-4a98-8d98-9b15d53f59b1 producer_ip = fd00:1122:3344:101::2 producer_port = 64820
9682026-07-28T03:14:41.323ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
9692026-07-28T03:14:41.324ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
9702026-07-28T03:14:41.331ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
9712026-07-28T03:14:41.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9722026-07-28T03:14:41.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9732026-07-28T03:14:41.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9742026-07-28T03:14:42.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9752026-07-28T03:14:42.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9762026-07-28T03:14:42.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9772026-07-28T03:14:42.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9782026-07-28T03:14:42.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9792026-07-28T03:14:42.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9802026-07-28T03:14:42.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9812026-07-28T03:14:42.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9822026-07-28T03:14:42.725ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9832026-07-28T03:14:43.172ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9842026-07-28T03:14:43.172ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9852026-07-28T03:14:43.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
9862026-07-28T03:14:43.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9872026-07-28T03:14:43.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9882026-07-28T03:14:43.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
9892026-07-28T03:14:43.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9902026-07-28T03:14:43.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9912026-07-28T03:14:43.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
9922026-07-28T03:14:43.750ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
9932026-07-28T03:14:43.750ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
9942026-07-28T03:14:43.752ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
9952026-07-28T03:14:43.910ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
9962026-07-28T03:14:43.910ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?sort_by=id_ascending
9972026-07-28T03:14:43.915ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "71a91330-1b12-4466-b938-bcf3762c7858", "content-length": "1412", "date": "Tue, 28 Jul 2026 03:14:43 GMT"} })
9982026-07-28T03:14:43.915ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWUxYTBhZS1iN2ViLTRmNjYtYjQzZS1lNTUxODZkMWM4NTEifX0%3D
9992026-07-28T03:14:43.918ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWUxYTBhZS1iN2ViLTRmNjYtYjQzZS1lNTUxODZkMWM4NTEifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1b77ad8-cd7c-408a-b791-7c6373bd86c0", "content-length": "29", "date": "Tue, 28 Jul 2026 03:14:43 GMT"} })
10002026-07-28T03:14:43.918ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 9 n_pruned_tasks = 0
10012026-07-28T03:14:44.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10022026-07-28T03:14:44.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10032026-07-28T03:14:44.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10042026-07-28T03:14:44.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10052026-07-28T03:14:44.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10062026-07-28T03:14:44.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10072026-07-28T03:14:44.385ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = bd69b1dd-776c-498f-a1ad-4e3f287c7d83 producer_ip = fd00:1122:3344:101::b producer_port = 51130
10082026-07-28T03:14:44.385ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = bd69b1dd-776c-498f-a1ad-4e3f287c7d83 producer_ip = fd00:1122:3344:101::b producer_port = 51130
10092026-07-28T03:14:44.386ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 4 producer_id = bd69b1dd-776c-498f-a1ad-4e3f287c7d83 producer_ip = fd00:1122:3344:101::b producer_port = 51130
10102026-07-28T03:14:44.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10112026-07-28T03:14:44.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10122026-07-28T03:14:44.725ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10132026-07-28T03:14:44.796ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 398
10142026-07-28T03:14:44.796ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 398
10152026-07-28T03:14:44.796ZDEBGoximeter (clickhouse-client): unrolling 398 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
10162026-07-28T03:14:44.796ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
10172026-07-28T03:14:44.804ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 280 table_name = fields_i16
10182026-07-28T03:14:44.806ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 877 table_name = fields_string
10192026-07-28T03:14:44.807ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 178 table_name = fields_u16
10202026-07-28T03:14:44.808ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 145 table_name = fields_u32
10212026-07-28T03:14:44.810ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 144 table_name = fields_u8
10222026-07-28T03:14:44.811ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 546 table_name = fields_uuid
10232026-07-28T03:14:44.812ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 4 table_name = measurements_bool
10242026-07-28T03:14:44.813ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 265 table_name = measurements_cumulativeu64
10252026-07-28T03:14:44.815ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 1 table_name = measurements_f64
10262026-07-28T03:14:44.817ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 38 table_name = measurements_histogramu64
10272026-07-28T03:14:44.818ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 90 table_name = measurements_u64
10282026-07-28T03:14:44.873ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = bd69b1dd-776c-498f-a1ad-4e3f287c7d83 producer_ip = fd00:1122:3344:101::b producer_port = 51130
10292026-07-28T03:14:44.897ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
10302026-07-28T03:14:45.172ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10312026-07-28T03:14:45.172ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10322026-07-28T03:14:45.173ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10332026-07-28T03:14:45.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10342026-07-28T03:14:45.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10352026-07-28T03:14:45.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10362026-07-28T03:14:45.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10372026-07-28T03:14:45.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10382026-07-28T03:14:45.727ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10392026-07-28T03:14:46.172ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10402026-07-28T03:14:46.172ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10412026-07-28T03:14:46.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10422026-07-28T03:14:46.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10432026-07-28T03:14:46.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10442026-07-28T03:14:46.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10452026-07-28T03:14:46.276ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = dca87a9a-e9f0-4227-9ca8-edb4b534193e producer_ip = fd00:1122:3344:101::c producer_port = 42397
10462026-07-28T03:14:46.276ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = dca87a9a-e9f0-4227-9ca8-edb4b534193e producer_ip = fd00:1122:3344:101::c producer_port = 42397
10472026-07-28T03:14:46.276ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = dca87a9a-e9f0-4227-9ca8-edb4b534193e producer_ip = fd00:1122:3344:101::c producer_port = 42397
10482026-07-28T03:14:46.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10492026-07-28T03:14:46.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10502026-07-28T03:14:46.727ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10512026-07-28T03:14:47.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10522026-07-28T03:14:47.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10532026-07-28T03:14:47.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10542026-07-28T03:14:47.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10552026-07-28T03:14:47.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10562026-07-28T03:14:47.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10572026-07-28T03:14:47.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10582026-07-28T03:14:47.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10592026-07-28T03:14:47.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10602026-07-28T03:14:48.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10612026-07-28T03:14:48.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10622026-07-28T03:14:48.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10632026-07-28T03:14:48.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10642026-07-28T03:14:48.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10652026-07-28T03:14:48.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10662026-07-28T03:14:48.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10672026-07-28T03:14:48.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10682026-07-28T03:14:48.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10692026-07-28T03:14:49.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10702026-07-28T03:14:49.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10712026-07-28T03:14:49.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10722026-07-28T03:14:49.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10732026-07-28T03:14:49.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10742026-07-28T03:14:49.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10752026-07-28T03:14:49.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10762026-07-28T03:14:49.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10772026-07-28T03:14:49.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10782026-07-28T03:14:49.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 225
10792026-07-28T03:14:49.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 225
10802026-07-28T03:14:49.795ZDEBGoximeter (clickhouse-client): unrolling 225 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
10812026-07-28T03:14:49.795ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
10822026-07-28T03:14:49.800ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 4 table_name = fields_ipaddr
10832026-07-28T03:14:49.802ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 88 table_name = fields_string
10842026-07-28T03:14:49.803ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 7 table_name = fields_u16
10852026-07-28T03:14:49.804ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 95 table_name = fields_uuid
10862026-07-28T03:14:49.806ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 162 table_name = measurements_cumulativeu64
10872026-07-28T03:14:49.808ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 3 table_name = measurements_histogramu64
10882026-07-28T03:14:49.809ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 60 table_name = measurements_u64
10892026-07-28T03:14:49.896ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
10902026-07-28T03:14:50.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10912026-07-28T03:14:50.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10922026-07-28T03:14:50.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
10932026-07-28T03:14:50.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10942026-07-28T03:14:50.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10952026-07-28T03:14:50.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
10962026-07-28T03:14:50.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10972026-07-28T03:14:50.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10982026-07-28T03:14:50.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
10992026-07-28T03:14:51.053ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11002026-07-28T03:14:51.172ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11012026-07-28T03:14:51.172ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11022026-07-28T03:14:51.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11032026-07-28T03:14:51.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11042026-07-28T03:14:51.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11052026-07-28T03:14:51.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11062026-07-28T03:14:51.233ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 7473a1f5-c4c3-4a98-8d98-9b15d53f59b1 producer_ip = fd00:1122:3344:101::2 producer_port = 64820
11072026-07-28T03:14:51.233ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 7473a1f5-c4c3-4a98-8d98-9b15d53f59b1 producer_ip = fd00:1122:3344:101::2 producer_port = 64820
11082026-07-28T03:14:51.234ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 2 n_samples = 11 producer_id = 7473a1f5-c4c3-4a98-8d98-9b15d53f59b1 producer_ip = fd00:1122:3344:101::2 producer_port = 64820
11092026-07-28T03:14:51.323ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
11102026-07-28T03:14:51.323ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
11112026-07-28T03:14:51.330ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 140 producer_id = eae1a0ae-b7eb-4f66-b43e-e55186d1c851 producer_ip = fd00:1122:3344:101::2 producer_port = 49513
11122026-07-28T03:14:51.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11132026-07-28T03:14:51.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11142026-07-28T03:14:51.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11152026-07-28T03:14:52.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11162026-07-28T03:14:52.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11172026-07-28T03:14:52.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11182026-07-28T03:14:52.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11192026-07-28T03:14:52.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11202026-07-28T03:14:52.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11212026-07-28T03:14:52.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11222026-07-28T03:14:52.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11232026-07-28T03:14:52.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11242026-07-28T03:14:53.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11252026-07-28T03:14:53.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11262026-07-28T03:14:53.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11272026-07-28T03:14:53.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11282026-07-28T03:14:53.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11292026-07-28T03:14:53.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11302026-07-28T03:14:53.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11312026-07-28T03:14:53.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11322026-07-28T03:14:53.727ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11332026-07-28T03:14:53.751ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
11342026-07-28T03:14:53.751ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
11352026-07-28T03:14:53.753ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 23 producer_id = b0ebb76c-e9a7-440f-9ccd-ca26541a0805 producer_ip = fd00:1122:3344:101::a producer_port = 49688
11362026-07-28T03:14:54.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11372026-07-28T03:14:54.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11382026-07-28T03:14:54.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11392026-07-28T03:14:54.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11402026-07-28T03:14:54.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11412026-07-28T03:14:54.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11422026-07-28T03:14:54.385ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = bd69b1dd-776c-498f-a1ad-4e3f287c7d83 producer_ip = fd00:1122:3344:101::b producer_port = 51130
11432026-07-28T03:14:54.385ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = bd69b1dd-776c-498f-a1ad-4e3f287c7d83 producer_ip = fd00:1122:3344:101::b producer_port = 51130
11442026-07-28T03:14:54.386ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 4 producer_id = bd69b1dd-776c-498f-a1ad-4e3f287c7d83 producer_ip = fd00:1122:3344:101::b producer_port = 51130
11452026-07-28T03:14:54.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11462026-07-28T03:14:54.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11472026-07-28T03:14:54.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11482026-07-28T03:14:54.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 400
11492026-07-28T03:14:54.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 400
11502026-07-28T03:14:54.795ZDEBGoximeter (clickhouse-client): unrolling 400 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
11512026-07-28T03:14:54.795ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
11522026-07-28T03:14:54.804ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 280 table_name = fields_i16
11532026-07-28T03:14:54.805ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 4 table_name = fields_ipaddr
11542026-07-28T03:14:54.807ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 879 table_name = fields_string
11552026-07-28T03:14:54.808ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 182 table_name = fields_u16
11562026-07-28T03:14:54.809ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 145 table_name = fields_u32
11572026-07-28T03:14:54.810ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 144 table_name = fields_u8
11582026-07-28T03:14:54.812ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 550 table_name = fields_uuid
11592026-07-28T03:14:54.813ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 4 table_name = measurements_bool
11602026-07-28T03:14:54.814ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 267 table_name = measurements_cumulativeu64
11612026-07-28T03:14:54.816ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 1 table_name = measurements_f64
11622026-07-28T03:14:54.816ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 005b0d90-8ee7-46fb-8ea6-4da97fb0b10c producer_ip = fd00:1122:3344:101::1 producer_port = 58804
11632026-07-28T03:14:54.816ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 005b0d90-8ee7-46fb-8ea6-4da97fb0b10c producer_ip = fd00:1122:3344:101::1 producer_port = 58804
11642026-07-28T03:14:54.818ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 38 table_name = measurements_histogramu64
11652026-07-28T03:14:54.819ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 90 table_name = measurements_u64
11662026-07-28T03:14:54.836ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 3 n_samples = 1694 producer_id = 005b0d90-8ee7-46fb-8ea6-4da97fb0b10c producer_ip = fd00:1122:3344:101::1 producer_port = 58804
11672026-07-28T03:14:54.840ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 1698
11682026-07-28T03:14:54.840ZDEBGoximeter (clickhouse-client): unrolling 1698 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
11692026-07-28T03:14:54.840ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
11702026-07-28T03:14:54.854ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 4 table_name = fields_ipaddr
11712026-07-28T03:14:54.856ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 2351 table_name = fields_string
11722026-07-28T03:14:54.857ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 15 table_name = fields_u16
11732026-07-28T03:14:54.859ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 801 table_name = fields_u32
11742026-07-28T03:14:54.860ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 1230 table_name = fields_uuid
11752026-07-28T03:14:54.862ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 1685 table_name = measurements_cumulativeu64
11762026-07-28T03:14:54.864ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 13 table_name = measurements_histogramu64
11772026-07-28T03:14:54.896ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
11782026-07-28T03:14:54.896ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 1698
11792026-07-28T03:14:54.998ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
11802026-07-28T03:14:55.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11812026-07-28T03:14:55.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11822026-07-28T03:14:55.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11832026-07-28T03:14:55.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11842026-07-28T03:14:55.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11852026-07-28T03:14:55.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11862026-07-28T03:14:55.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11872026-07-28T03:14:55.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11882026-07-28T03:14:55.725ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11892026-07-28T03:14:56.172ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11902026-07-28T03:14:56.172ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11912026-07-28T03:14:56.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
11922026-07-28T03:14:56.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11932026-07-28T03:14:56.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11942026-07-28T03:14:56.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
11952026-07-28T03:14:56.275ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = dca87a9a-e9f0-4227-9ca8-edb4b534193e producer_ip = fd00:1122:3344:101::c producer_port = 42397
11962026-07-28T03:14:56.275ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = dca87a9a-e9f0-4227-9ca8-edb4b534193e producer_ip = fd00:1122:3344:101::c producer_port = 42397
11972026-07-28T03:14:56.276ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 5 n_samples = 3 producer_id = dca87a9a-e9f0-4227-9ca8-edb4b534193e producer_ip = fd00:1122:3344:101::c producer_port = 42397
11982026-07-28T03:14:56.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
11992026-07-28T03:14:56.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12002026-07-28T03:14:56.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12012026-07-28T03:14:57.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12022026-07-28T03:14:57.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12032026-07-28T03:14:57.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12042026-07-28T03:14:57.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12052026-07-28T03:14:57.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12062026-07-28T03:14:57.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12072026-07-28T03:14:57.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12082026-07-28T03:14:57.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12092026-07-28T03:14:57.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12102026-07-28T03:14:58.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12112026-07-28T03:14:58.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12122026-07-28T03:14:58.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12132026-07-28T03:14:58.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12142026-07-28T03:14:58.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12152026-07-28T03:14:58.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12162026-07-28T03:14:58.724ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12172026-07-28T03:14:58.724ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12182026-07-28T03:14:58.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12192026-07-28T03:14:58.910ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:629
12202026-07-28T03:14:58.910ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?sort_by=id_ascending
12212026-07-28T03:14:58.914ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "d510be2d-ba98-4c81-b73b-373bded751b9", "content-length": "1412", "date": "Tue, 28 Jul 2026 03:14:58 GMT"} })
12222026-07-28T03:14:58.914ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWUxYTBhZS1iN2ViLTRmNjYtYjQzZS1lNTUxODZkMWM4NTEifX0%3D
12232026-07-28T03:14:58.917ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWUxYTBhZS1iN2ViLTRmNjYtYjQzZS1lNTUxODZkMWM4NTEifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "3aa3b190-128e-46ab-8711-bfe72b8b4c52", "content-length": "29", "date": "Tue, 28 Jul 2026 03:14:58 GMT"} })
12242026-07-28T03:14:58.917ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:704 n_current_tasks = 9 n_pruned_tasks = 0
12252026-07-28T03:14:59.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12262026-07-28T03:14:59.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12272026-07-28T03:14:59.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12282026-07-28T03:14:59.219ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12292026-07-28T03:14:59.219ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12302026-07-28T03:14:59.220ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12312026-07-28T03:14:59.725ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12322026-07-28T03:14:59.725ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12332026-07-28T03:14:59.726ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 55e3cd34-3009-453e-a52b-b57e4cd6412e producer_ip = fd00:1122:3344:101::1 producer_port = 8001
12342026-07-28T03:14:59.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 223
12352026-07-28T03:14:59.795ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_samples = 223
12362026-07-28T03:14:59.795ZDEBGoximeter (clickhouse-client): unrolling 223 total samples collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
12372026-07-28T03:14:59.796ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2
12382026-07-28T03:14:59.801ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 86 table_name = fields_string
12392026-07-28T03:14:59.802ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 3 table_name = fields_u16
12402026-07-28T03:14:59.804ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 91 table_name = fields_uuid
12412026-07-28T03:14:59.805ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 160 table_name = measurements_cumulativeu64
12422026-07-28T03:14:59.807ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 3 table_name = measurements_histogramu64
12432026-07-28T03:14:59.808ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d id = e4bac6bd-f0bd-4398-b1c1-6c907efcf7c2 n_rows = 60 table_name = measurements_u64
12442026-07-28T03:14:59.896ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:276
12452026-07-28T03:15:00.171ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12462026-07-28T03:15:00.171ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12472026-07-28T03:15:00.172ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 4 producer_id = 119f3195-b291-44bb-9ba1-494dad70adef producer_ip = fd00:1122:3344:101::2 producer_port = 4677
12482026-07-28T03:15:00.218ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12492026-07-28T03:15:00.218ZDEBGoximeter (collection-task): collecting from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001
12502026-07-28T03:15:00.219ZDEBGoximeter (collection-task): collected results from producer collector_id = 68536d04-86bc-4f1b-b0b3-e2d4dc0a91e8 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 14 producer_id = 27b3f311-08d5-403d-9b74-dfc039b405db producer_ip = fd00:1122:3344:101::2 producer_port = 8001