Max level shown:
1 [ Jun 24 04:43:04 Enabled. ]
2 [ Jun 24 04:43:04 Rereading configuration. ]
3 [ Jun 24 04:43:06 Rereading configuration. ]
4 [ Jun 24 04:43:11 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id 3644ccd5-3d06-4276-907c-a58b9b7d5591 &"). ]
5 [ Jun 24 04:43:11 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-06-24T04:43:11.827ZDEBGoximeter: registered DTrace probes
82026-06-24T04:43:11.834ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:301
92026-06-24T04:43:11.835ZDEBGoximeter: creating ClickHouse client
102026-06-24T04:43:11.841ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
112026-06-24T04:43:13.844ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:890 id = af193533-7031-41da-aa01-6ea0cef51994
122026-06-24T04:43:13.844ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d
132026-06-24T04:43:13.844ZINFOoximeter (clickhouse-client): reading db version collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:790 id = af193533-7031-41da-aa01-6ea0cef51994
142026-06-24T04:43:13.845ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:890 id = af193533-7031-41da-aa01-6ea0cef51994
152026-06-24T04:43:13.845ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:795 id = af193533-7031-41da-aa01-6ea0cef51994 version = 0
162026-06-24T04:43:13.845ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:800 id = af193533-7031-41da-aa01-6ea0cef51994
172026-06-24T04:43:13.845ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
182026-06-24T04:43:14.729ZINFOoximeter (clickhouse-client): inserting current version collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:821 id = af193533-7031-41da-aa01-6ea0cef51994 version = 14
192026-06-24T04:43:14.747ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = 6b5ae4f6-b2d9-4241-b070-ebb7ed16fd66
202026-06-24T04:43:14.756ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-06-24T04:43:14.756ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-06-24T04:43:14.756ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-06-24T04:43:14.756ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-06-24T04:43:14.756ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:335 local_addr = [fd00:1122:3344:101::d]:12223
252026-06-24T04:43:14.758ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-06-24T04:43:14.759ZDEBGoximeter: registered USDT probes
272026-06-24T04:43:14.759ZDEBGoximeter: contacting nexus
282026-06-24T04:43:14.782ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
292026-06-24T04:43:14.786ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::c]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
302026-06-24T04:43:14.786ZWARNoximeter: failed to contact nexus, will retry in 333.26092ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:446
312026-06-24T04:43:15.121ZDEBGoximeter: contacting nexus
322026-06-24T04:43:15.121ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
332026-06-24T04:43:15.121ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
342026-06-24T04:43:15.121ZWARNoximeter: failed to contact nexus, will retry in 733.413849ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:446
352026-06-24T04:43:15.855ZDEBGoximeter: contacting nexus
362026-06-24T04:43:15.855ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
372026-06-24T04:43:15.855ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
382026-06-24T04:43:15.855ZWARNoximeter: failed to contact nexus, will retry in 699.591906ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:446
392026-06-24T04:43:16.556ZDEBGoximeter: contacting nexus
402026-06-24T04:43:16.556ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
412026-06-24T04:43:16.557ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
422026-06-24T04:43:16.557ZWARNoximeter: failed to contact nexus, will retry in 1.302648119s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:446
432026-06-24T04:43:17.861ZDEBGoximeter: contacting nexus
442026-06-24T04:43:17.861ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
452026-06-24T04:43:17.861ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
462026-06-24T04:43:17.861ZWARNoximeter: failed to contact nexus, will retry in 4.644527853s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:446
472026-06-24T04:43:19.764ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d
482026-06-24T04:43:19.764ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d
492026-06-24T04:43:22.507ZDEBGoximeter: contacting nexus
502026-06-24T04:43:22.507ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
512026-06-24T04:43:22.839ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", status: 204, headers: {"x-request-id": "5adc7c06-8cb9-498b-bf54-a7d0894ae9ff", "date": "Wed, 24 Jun 2026 04:43:22 GMT"} })
522026-06-24T04:43:22.840ZINFOoximeter: oximeter registered with nexus file = oximeter/collector/src/lib.rs:464 id = 3644ccd5-3d06-4276-907c-a58b9b7d5591
532026-06-24T04:43:22.840ZINFOoximeter (oximeter-agent): starting refresh list task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:562
542026-06-24T04:43:22.841ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
552026-06-24T04:43:22.845ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/3644ccd5-3d06-4276-907c-a58b9b7d5591/producers?sort_by=id_ascending
562026-06-24T04:43:22.886ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/3644ccd5-3d06-4276-907c-a58b9b7d5591/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "142d3f8c-7c29-4027-8523-41d6df8b2ffb", "content-length": "29", "date": "Wed, 24 Jun 2026 04:43:22 GMT"} })
572026-06-24T04:43:22.886ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 0 n_pruned_tasks = 0
582026-06-24T04:43:24.765ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d
592026-06-24T04:43:24.765ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d
602026-06-24T04:43:29.764ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d
612026-06-24T04:43:29.764ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d
622026-06-24T04:43:34.764ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d
632026-06-24T04:43:34.765ZDEBGoximeter (database-inserter): batch interval expired, but no samples to insert collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d
642026-06-24T04:43:37.841ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
652026-06-24T04:43:37.841ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/3644ccd5-3d06-4276-907c-a58b9b7d5591/producers?sort_by=id_ascending
662026-06-24T04:43:37.981ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/3644ccd5-3d06-4276-907c-a58b9b7d5591/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "09cd88d3-cd23-4e42-b141-a16a785d9a48", "content-length": "436", "date": "Wed, 24 Jun 2026 04:43:37 GMT"} })
672026-06-24T04:43:37.986ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/3644ccd5-3d06-4276-907c-a58b9b7d5591/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhODJmMjViYi0xZGUyLTQ1YTgtYjIyMi1iYmM5NTljZTgwY2EifX0%3D
682026-06-24T04:43:37.992ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/3644ccd5-3d06-4276-907c-a58b9b7d5591/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhODJmMjViYi0xZGUyLTQ1YTgtYjIyMi1iYmM5NTljZTgwY2EifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c2f65ab-408b-4d48-a65b-4d67cd574c02", "content-length": "29", "date": "Wed, 24 Jun 2026 04:43:37 GMT"} })
692026-06-24T04:43:37.992ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::1]:8001 collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160
702026-06-24T04:43:37.997ZDEBGoximeter (oximeter-agent): registered new metric producer address = [fd00:1122:3344:101::2]:35101 collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = a82f25bb-1de2-45a8-b222-bbc959ce80ca
712026-06-24T04:43:37.997ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 2 n_pruned_tasks = 0
722026-06-24T04:43:38.000ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = a82f25bb-1de2-45a8-b222-bbc959ce80ca producer_ip = fd00:1122:3344:101::2 producer_port = 35101
732026-06-24T04:43:38.000ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
742026-06-24T04:43:38.000ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = a82f25bb-1de2-45a8-b222-bbc959ce80ca producer_ip = fd00:1122:3344:101::2 producer_port = 35101
752026-06-24T04:43:38.000ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
762026-06-24T04:43:38.021ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
772026-06-24T04:43:38.026ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = a82f25bb-1de2-45a8-b222-bbc959ce80ca producer_ip = fd00:1122:3344:101::2 producer_port = 35101
782026-06-24T04:43:38.040ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
792026-06-24T04:43:38.065ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 264 producer_id = a82f25bb-1de2-45a8-b222-bbc959ce80ca producer_ip = fd00:1122:3344:101::2 producer_port = 35101
802026-06-24T04:43:38.998ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
812026-06-24T04:43:38.998ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
822026-06-24T04:43:39.002ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
832026-06-24T04:43:39.765ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 318
842026-06-24T04:43:39.765ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 318
852026-06-24T04:43:39.767ZDEBGoximeter (clickhouse-client): unrolling 318 total samples collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
862026-06-24T04:43:39.786ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
872026-06-24T04:43:39.804ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-24T04:43:39.770243617Z } timeseries_name = ddm_router:originated_tunnel_endpoints
882026-06-24T04:43:39.804ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_router:originated_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-24T04:43:39.770175515Z } timeseries_name = ddm_router:originated_underlay_prefixes
892026-06-24T04:43:39.804ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-24T04:43:39.770592595Z } timeseries_name = ddm_session:advertisements_received
902026-06-24T04:43:39.804ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:advertisements_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-24T04:43:39.770477562Z } timeseries_name = ddm_session:advertisements_sent
912026-06-24T04:43:39.804ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_tunnel_endpoints"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-24T04:43:39.771091546Z } timeseries_name = ddm_session:imported_tunnel_endpoints
922026-06-24T04:43:39.804ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:imported_underlay_prefixes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: U64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-24T04:43:39.771029975Z } timeseries_name = ddm_session:imported_underlay_prefixes
932026-06-24T04:43:39.804ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_address_changes"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-24T04:43:39.770722548Z } timeseries_name = ddm_session:peer_address_changes
942026-06-24T04:43:39.804ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_expirations"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-24T04:43:39.770657327Z } timeseries_name = ddm_session:peer_expirations
952026-06-24T04:43:39.804ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:peer_sessions_established"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-24T04:43:39.770786730Z } timeseries_name = ddm_session:peer_sessions_established
962026-06-24T04:43:39.804ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-24T04:43:39.770381350Z } timeseries_name = ddm_session:solicitations_received
972026-06-24T04:43:39.804ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:solicitations_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-24T04:43:39.770319819Z } timeseries_name = ddm_session:solicitations_sent
982026-06-24T04:43:39.804ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:update_send_fail"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-24T04:43:39.770968864Z } timeseries_name = ddm_session:update_send_fail
992026-06-24T04:43:39.804ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-24T04:43:39.770906802Z } timeseries_name = ddm_session:updates_received
1002026-06-24T04:43:39.804ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 schema = TimeseriesSchema { timeseries_name: TimeseriesName("ddm_session:updates_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "hostname", field_type: String, source: Target, description: "" }, FieldSchema { name: "interface", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-24T04:43:39.770846751Z } timeseries_name = ddm_session:updates_sent
1012026-06-24T04:43:39.804ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 schema = TimeseriesSchema { timeseries_name: TimeseriesName("oximeter_collector:collections"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "base_route", field_type: String, source: Metric, description: "" }, FieldSchema { name: "collector_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "collector_ip", field_type: IpAddr, source: Target, description: "" }, FieldSchema { name: "collector_port", field_type: U16, source: Target, description: "" }, FieldSchema { name: "producer_id", field_type: Uuid, source: Metric, description: "" }, FieldSchema { name: "producer_ip", field_type: IpAddr, source: Metric, description: "" }, FieldSchema { name: "producer_port", field_type: U16, source: Metric, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-24T04:43:39.770032352Z } timeseries_name = oximeter_collector:collections
1022026-06-24T04:43:39.804ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-24T04:43:39.771640759Z } timeseries_name = switch_port_control_data_link:bytes_received
1032026-06-24T04:43:39.804ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:bytes_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-24T04:43:39.771812153Z } timeseries_name = switch_port_control_data_link:bytes_sent
1042026-06-24T04:43:39.804ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-24T04:43:39.771508376Z } timeseries_name = switch_port_control_data_link:errors_received
1052026-06-24T04:43:39.804ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:errors_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-24T04:43:39.771575668Z } timeseries_name = switch_port_control_data_link:errors_sent
1062026-06-24T04:43:39.804ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_received"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-24T04:43:39.771728391Z } timeseries_name = switch_port_control_data_link:packets_received
1072026-06-24T04:43:39.804ZDEBGoximeter (clickhouse-client): new timeseries schema collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 schema = TimeseriesSchema { timeseries_name: TimeseriesName("switch_port_control_data_link:packets_sent"), description: TimeseriesDescription { target: "", metric: "" }, field_schema: {FieldSchema { name: "asic_fab", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_lot", field_type: String, source: Target, description: "" }, FieldSchema { name: "asic_wafer", field_type: U8, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_x", field_type: I16, source: Target, description: "" }, FieldSchema { name: "asic_wafer_loc_y", field_type: I16, source: Target, description: "" }, FieldSchema { name: "kind", field_type: String, source: Target, description: "" }, FieldSchema { name: "link_name", field_type: String, source: Target, description: "" }, FieldSchema { name: "model", field_type: String, source: Target, description: "" }, FieldSchema { name: "network", field_type: String, source: Target, description: "" }, FieldSchema { name: "rack_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "sled_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "sled_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "sled_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_id", field_type: Uuid, source: Target, description: "" }, FieldSchema { name: "switch_model", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_revision", field_type: U32, source: Target, description: "" }, FieldSchema { name: "switch_serial", field_type: String, source: Target, description: "" }, FieldSchema { name: "switch_slot", field_type: U16, source: Target, description: "" }}, datum_type: CumulativeU64, version: 1, authz_scope: Fleet, units: Count, created: 2026-06-24T04:43:39.771893145Z } timeseries_name = switch_port_control_data_link:packets_sent
1082026-06-24T04:43:39.813ZDEBGoximeter (clickhouse-client): inserting 21 new timeseries schema collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
1092026-06-24T04:43:39.838ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 24 table_name = fields_i16
1102026-06-24T04:43:39.840ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 4 table_name = fields_ipaddr
1112026-06-24T04:43:39.841ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 172 table_name = fields_string
1122026-06-24T04:43:39.843ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 16 table_name = fields_u16
1132026-06-24T04:43:39.844ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 24 table_name = fields_u32
1142026-06-24T04:43:39.845ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 12 table_name = fields_u8
1152026-06-24T04:43:39.847ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 92 table_name = fields_uuid
1162026-06-24T04:43:39.852ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 306 table_name = measurements_cumulativeu64
1172026-06-24T04:43:39.854ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 12 table_name = measurements_u64
1182026-06-24T04:43:39.868ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
1192026-06-24T04:43:39.998ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1202026-06-24T04:43:39.998ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1212026-06-24T04:43:40.000ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1222026-06-24T04:43:40.998ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1232026-06-24T04:43:40.998ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1242026-06-24T04:43:41.001ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1252026-06-24T04:43:41.997ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1262026-06-24T04:43:41.998ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1272026-06-24T04:43:42.000ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1282026-06-24T04:43:42.998ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1292026-06-24T04:43:42.998ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1302026-06-24T04:43:43.001ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1312026-06-24T04:43:43.998ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1322026-06-24T04:43:43.998ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1332026-06-24T04:43:44.000ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1342026-06-24T04:43:44.765ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
1352026-06-24T04:43:44.765ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
1362026-06-24T04:43:44.765ZDEBGoximeter (clickhouse-client): unrolling 130 total samples collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
1372026-06-24T04:43:44.770ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
1382026-06-24T04:43:44.819ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 50 table_name = fields_string
1392026-06-24T04:43:44.820ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 52 table_name = fields_uuid
1402026-06-24T04:43:44.821ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 100 table_name = measurements_cumulativeu64
1412026-06-24T04:43:44.822ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 30 table_name = measurements_u64
1422026-06-24T04:43:44.867ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
1432026-06-24T04:43:44.998ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1442026-06-24T04:43:44.998ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1452026-06-24T04:43:45.000ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1462026-06-24T04:43:45.998ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1472026-06-24T04:43:45.998ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1482026-06-24T04:43:46.002ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1492026-06-24T04:43:46.998ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1502026-06-24T04:43:46.998ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1512026-06-24T04:43:47.001ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1522026-06-24T04:43:48.355ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1532026-06-24T04:43:48.355ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1542026-06-24T04:43:48.358ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1552026-06-24T04:43:49.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1562026-06-24T04:43:49.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1572026-06-24T04:43:49.358ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1582026-06-24T04:43:50.122ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
1592026-06-24T04:43:50.122ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
1602026-06-24T04:43:50.122ZDEBGoximeter (clickhouse-client): unrolling 130 total samples collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
1612026-06-24T04:43:50.127ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
1622026-06-24T04:43:50.131ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 50 table_name = fields_string
1632026-06-24T04:43:50.133ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 52 table_name = fields_uuid
1642026-06-24T04:43:50.134ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 100 table_name = measurements_cumulativeu64
1652026-06-24T04:43:50.135ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 30 table_name = measurements_u64
1662026-06-24T04:43:50.223ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
1672026-06-24T04:43:50.355ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1682026-06-24T04:43:50.355ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1692026-06-24T04:43:50.358ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1702026-06-24T04:43:51.355ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1712026-06-24T04:43:51.355ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1722026-06-24T04:43:51.358ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1732026-06-24T04:43:52.355ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1742026-06-24T04:43:52.355ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1752026-06-24T04:43:52.358ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1762026-06-24T04:43:53.198ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
1772026-06-24T04:43:53.199ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/3644ccd5-3d06-4276-907c-a58b9b7d5591/producers?sort_by=id_ascending
1782026-06-24T04:43:53.264ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/3644ccd5-3d06-4276-907c-a58b9b7d5591/producers?sort_by=id_ascending", status: 200, headers: {"content-type": "application/json", "x-request-id": "043caf9f-0df1-41d2-bdb0-a27e94ce0895", "content-length": "436", "date": "Wed, 24 Jun 2026 04:43:53 GMT"} })
1792026-06-24T04:43:53.264ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors/3644ccd5-3d06-4276-907c-a58b9b7d5591/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhODJmMjViYi0xZGUyLTQ1YTgtYjIyMi1iYmM5NTljZTgwY2EifX0%3D
1802026-06-24T04:43:53.271ZDEBGoximeter: client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors/3644ccd5-3d06-4276-907c-a58b9b7d5591/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJhODJmMjViYi0xZGUyLTQ1YTgtYjIyMi1iYmM5NTljZTgwY2EifX0%3D", status: 200, headers: {"content-type": "application/json", "x-request-id": "8cef3847-34a0-4672-9a1c-f341ebe06521", "content-length": "29", "date": "Wed, 24 Jun 2026 04:43:53 GMT"} })
1812026-06-24T04:43:53.271ZINFOoximeter (oximeter-agent): refreshed list of producers from Nexus collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:640 n_current_tasks = 2 n_pruned_tasks = 0
1822026-06-24T04:43:53.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1832026-06-24T04:43:53.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1842026-06-24T04:43:53.358ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1852026-06-24T04:43:54.355ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1862026-06-24T04:43:54.355ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1872026-06-24T04:43:54.358ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1882026-06-24T04:43:55.122ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
1892026-06-24T04:43:55.122ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
1902026-06-24T04:43:55.122ZDEBGoximeter (clickhouse-client): unrolling 130 total samples collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
1912026-06-24T04:43:55.127ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
1922026-06-24T04:43:55.132ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 50 table_name = fields_string
1932026-06-24T04:43:55.133ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 52 table_name = fields_uuid
1942026-06-24T04:43:55.134ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 100 table_name = measurements_cumulativeu64
1952026-06-24T04:43:55.135ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 30 table_name = measurements_u64
1962026-06-24T04:43:55.223ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
1972026-06-24T04:43:55.355ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1982026-06-24T04:43:55.355ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
1992026-06-24T04:43:55.358ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2002026-06-24T04:43:56.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2012026-06-24T04:43:56.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2022026-06-24T04:43:56.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2032026-06-24T04:43:57.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2042026-06-24T04:43:57.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2052026-06-24T04:43:57.358ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2062026-06-24T04:43:58.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2072026-06-24T04:43:58.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2082026-06-24T04:43:58.358ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2092026-06-24T04:43:59.355ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2102026-06-24T04:43:59.355ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2112026-06-24T04:43:59.358ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2122026-06-24T04:44:00.123ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
2132026-06-24T04:44:00.123ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
2142026-06-24T04:44:00.123ZDEBGoximeter (clickhouse-client): unrolling 130 total samples collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
2152026-06-24T04:44:00.128ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
2162026-06-24T04:44:00.133ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 50 table_name = fields_string
2172026-06-24T04:44:00.134ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 52 table_name = fields_uuid
2182026-06-24T04:44:00.135ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 100 table_name = measurements_cumulativeu64
2192026-06-24T04:44:00.137ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 30 table_name = measurements_u64
2202026-06-24T04:44:00.224ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
2212026-06-24T04:44:00.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2222026-06-24T04:44:00.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2232026-06-24T04:44:00.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2242026-06-24T04:44:01.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2252026-06-24T04:44:01.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2262026-06-24T04:44:01.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2272026-06-24T04:44:02.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2282026-06-24T04:44:02.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2292026-06-24T04:44:02.358ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2302026-06-24T04:44:03.355ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2312026-06-24T04:44:03.355ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2322026-06-24T04:44:03.358ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2332026-06-24T04:44:04.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2342026-06-24T04:44:04.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2352026-06-24T04:44:04.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2362026-06-24T04:44:05.123ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
2372026-06-24T04:44:05.123ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
2382026-06-24T04:44:05.123ZDEBGoximeter (clickhouse-client): unrolling 130 total samples collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
2392026-06-24T04:44:05.127ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
2402026-06-24T04:44:05.132ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 50 table_name = fields_string
2412026-06-24T04:44:05.133ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 52 table_name = fields_uuid
2422026-06-24T04:44:05.134ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 100 table_name = measurements_cumulativeu64
2432026-06-24T04:44:05.136ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 30 table_name = measurements_u64
2442026-06-24T04:44:05.224ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
2452026-06-24T04:44:05.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2462026-06-24T04:44:05.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2472026-06-24T04:44:05.358ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2482026-06-24T04:44:06.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2492026-06-24T04:44:06.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2502026-06-24T04:44:06.358ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2512026-06-24T04:44:07.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2522026-06-24T04:44:07.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2532026-06-24T04:44:07.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2542026-06-24T04:44:08.199ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
2552026-06-24T04:44:08.199ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/3644ccd5-3d06-4276-907c-a58b9b7d5591/producers?sort_by=id_ascending
2562026-06-24T04:44:08.199ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/3644ccd5-3d06-4276-907c-a58b9b7d5591/producers?sort_by=id_ascending", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
2572026-06-24T04:44:08.199ZERROoximeter (oximeter-agent): error fetching next assigned producer, abandoning this refresh attempt collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors/3644ccd5-3d06-4276-907c-a58b9b7d5591/producers?sort_by=id_ascending): error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors/3644ccd5-3d06-4276-907c-a58b9b7d5591/producers?sort_by=id_ascending): client error (Connect): tcp connect error: Connection refused (os error 146) file = oximeter/collector/src/agent.rs:603
2582026-06-24T04:44:08.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2592026-06-24T04:44:08.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = a82f25bb-1de2-45a8-b222-bbc959ce80ca producer_ip = fd00:1122:3344:101::2 producer_port = 35101
2602026-06-24T04:44:08.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = a82f25bb-1de2-45a8-b222-bbc959ce80ca producer_ip = fd00:1122:3344:101::2 producer_port = 35101
2612026-06-24T04:44:08.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2622026-06-24T04:44:08.358ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2632026-06-24T04:44:08.360ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 36 producer_id = a82f25bb-1de2-45a8-b222-bbc959ce80ca producer_ip = fd00:1122:3344:101::2 producer_port = 35101
2642026-06-24T04:44:09.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2652026-06-24T04:44:09.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2662026-06-24T04:44:09.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2672026-06-24T04:44:10.123ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 166
2682026-06-24T04:44:10.123ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 166
2692026-06-24T04:44:10.123ZDEBGoximeter (clickhouse-client): unrolling 166 total samples collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
2702026-06-24T04:44:10.129ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
2712026-06-24T04:44:10.134ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 24 table_name = fields_i16
2722026-06-24T04:44:10.135ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 170 table_name = fields_string
2732026-06-24T04:44:10.137ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 12 table_name = fields_u16
2742026-06-24T04:44:10.138ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 24 table_name = fields_u32
2752026-06-24T04:44:10.139ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 12 table_name = fields_u8
2762026-06-24T04:44:10.140ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 88 table_name = fields_uuid
2772026-06-24T04:44:10.141ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 136 table_name = measurements_cumulativeu64
2782026-06-24T04:44:10.143ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 30 table_name = measurements_u64
2792026-06-24T04:44:10.224ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
2802026-06-24T04:44:10.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2812026-06-24T04:44:10.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2822026-06-24T04:44:10.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2832026-06-24T04:44:11.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2842026-06-24T04:44:11.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2852026-06-24T04:44:11.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2862026-06-24T04:44:12.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2872026-06-24T04:44:12.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2882026-06-24T04:44:12.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2892026-06-24T04:44:13.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2902026-06-24T04:44:13.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2912026-06-24T04:44:13.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2922026-06-24T04:44:14.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2932026-06-24T04:44:14.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2942026-06-24T04:44:14.358ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
2952026-06-24T04:44:15.123ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
2962026-06-24T04:44:15.123ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
2972026-06-24T04:44:15.123ZDEBGoximeter (clickhouse-client): unrolling 130 total samples collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
2982026-06-24T04:44:15.128ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
2992026-06-24T04:44:15.132ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 50 table_name = fields_string
3002026-06-24T04:44:15.134ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 52 table_name = fields_uuid
3012026-06-24T04:44:15.135ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 100 table_name = measurements_cumulativeu64
3022026-06-24T04:44:15.136ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 30 table_name = measurements_u64
3032026-06-24T04:44:15.224ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
3042026-06-24T04:44:15.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3052026-06-24T04:44:15.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3062026-06-24T04:44:15.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3072026-06-24T04:44:16.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3082026-06-24T04:44:16.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3092026-06-24T04:44:16.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3102026-06-24T04:44:17.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3112026-06-24T04:44:17.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3122026-06-24T04:44:17.358ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3132026-06-24T04:44:18.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3142026-06-24T04:44:18.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3152026-06-24T04:44:18.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3162026-06-24T04:44:19.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3172026-06-24T04:44:19.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3182026-06-24T04:44:19.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3192026-06-24T04:44:20.124ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
3202026-06-24T04:44:20.124ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
3212026-06-24T04:44:20.124ZDEBGoximeter (clickhouse-client): unrolling 130 total samples collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
3222026-06-24T04:44:20.128ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
3232026-06-24T04:44:20.133ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 50 table_name = fields_string
3242026-06-24T04:44:20.134ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 52 table_name = fields_uuid
3252026-06-24T04:44:20.136ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 100 table_name = measurements_cumulativeu64
3262026-06-24T04:44:20.137ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 30 table_name = measurements_u64
3272026-06-24T04:44:20.224ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
3282026-06-24T04:44:20.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3292026-06-24T04:44:20.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3302026-06-24T04:44:20.358ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3312026-06-24T04:44:21.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3322026-06-24T04:44:21.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3332026-06-24T04:44:21.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3342026-06-24T04:44:22.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3352026-06-24T04:44:22.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3362026-06-24T04:44:22.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3372026-06-24T04:44:23.200ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
3382026-06-24T04:44:23.200ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors/3644ccd5-3d06-4276-907c-a58b9b7d5591/producers?sort_by=id_ascending
3392026-06-24T04:44:23.200ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors/3644ccd5-3d06-4276-907c-a58b9b7d5591/producers?sort_by=id_ascending", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
3402026-06-24T04:44:23.200ZERROoximeter (oximeter-agent): error fetching next assigned producer, abandoning this refresh attempt collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors/3644ccd5-3d06-4276-907c-a58b9b7d5591/producers?sort_by=id_ascending): error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors/3644ccd5-3d06-4276-907c-a58b9b7d5591/producers?sort_by=id_ascending): client error (Connect): tcp connect error: Connection refused (os error 146) file = oximeter/collector/src/agent.rs:603
3412026-06-24T04:44:23.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3422026-06-24T04:44:23.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3432026-06-24T04:44:23.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3442026-06-24T04:44:24.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3452026-06-24T04:44:24.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3462026-06-24T04:44:24.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3472026-06-24T04:44:25.124ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
3482026-06-24T04:44:25.124ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
3492026-06-24T04:44:25.124ZDEBGoximeter (clickhouse-client): unrolling 130 total samples collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
3502026-06-24T04:44:25.128ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
3512026-06-24T04:44:25.134ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 50 table_name = fields_string
3522026-06-24T04:44:25.135ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 52 table_name = fields_uuid
3532026-06-24T04:44:25.136ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 100 table_name = measurements_cumulativeu64
3542026-06-24T04:44:25.137ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 30 table_name = measurements_u64
3552026-06-24T04:44:25.226ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
3562026-06-24T04:44:25.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3572026-06-24T04:44:25.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3582026-06-24T04:44:25.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3592026-06-24T04:44:26.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3602026-06-24T04:44:26.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3612026-06-24T04:44:26.360ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3622026-06-24T04:44:27.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3632026-06-24T04:44:27.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3642026-06-24T04:44:27.361ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3652026-06-24T04:44:28.356ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3662026-06-24T04:44:28.356ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3672026-06-24T04:44:28.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3682026-06-24T04:44:29.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3692026-06-24T04:44:29.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3702026-06-24T04:44:29.360ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3712026-06-24T04:44:30.124ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
3722026-06-24T04:44:30.124ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
3732026-06-24T04:44:30.124ZDEBGoximeter (clickhouse-client): unrolling 130 total samples collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
3742026-06-24T04:44:30.128ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
3752026-06-24T04:44:30.133ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 50 table_name = fields_string
3762026-06-24T04:44:30.134ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 52 table_name = fields_uuid
3772026-06-24T04:44:30.136ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 100 table_name = measurements_cumulativeu64
3782026-06-24T04:44:30.137ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 30 table_name = measurements_u64
3792026-06-24T04:44:30.227ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
3802026-06-24T04:44:30.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3812026-06-24T04:44:30.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3822026-06-24T04:44:30.360ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3832026-06-24T04:44:31.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3842026-06-24T04:44:31.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3852026-06-24T04:44:31.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3862026-06-24T04:44:32.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3872026-06-24T04:44:32.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3882026-06-24T04:44:32.360ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3892026-06-24T04:44:33.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3902026-06-24T04:44:33.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3912026-06-24T04:44:33.360ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3922026-06-24T04:44:34.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3932026-06-24T04:44:34.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3942026-06-24T04:44:34.360ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
3952026-06-24T04:44:35.124ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
3962026-06-24T04:44:35.124ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
3972026-06-24T04:44:35.124ZDEBGoximeter (clickhouse-client): unrolling 130 total samples collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
3982026-06-24T04:44:35.128ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
3992026-06-24T04:44:35.133ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 50 table_name = fields_string
4002026-06-24T04:44:35.135ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 52 table_name = fields_uuid
4012026-06-24T04:44:35.137ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 100 table_name = measurements_cumulativeu64
4022026-06-24T04:44:35.138ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 30 table_name = measurements_u64
4032026-06-24T04:44:35.225ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
4042026-06-24T04:44:35.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4052026-06-24T04:44:35.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4062026-06-24T04:44:35.360ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4072026-06-24T04:44:36.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4082026-06-24T04:44:36.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4092026-06-24T04:44:36.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4102026-06-24T04:44:37.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4112026-06-24T04:44:37.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4122026-06-24T04:44:37.360ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4132026-06-24T04:44:38.200ZINFOoximeter (oximeter-agent): refreshing list of producers from Nexus collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d file = oximeter/collector/src/agent.rs:565
4142026-06-24T04:44:38.200ZDEBGoximeter: client request body = None method = GET uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors/3644ccd5-3d06-4276-907c-a58b9b7d5591/producers?sort_by=id_ascending
4152026-06-24T04:44:38.200ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors/3644ccd5-3d06-4276-907c-a58b9b7d5591/producers?sort_by=id_ascending", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
4162026-06-24T04:44:38.200ZERROoximeter (oximeter-agent): error fetching next assigned producer, abandoning this refresh attempt collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors/3644ccd5-3d06-4276-907c-a58b9b7d5591/producers?sort_by=id_ascending): error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors/3644ccd5-3d06-4276-907c-a58b9b7d5591/producers?sort_by=id_ascending): client error (Connect): tcp connect error: Connection refused (os error 146) file = oximeter/collector/src/agent.rs:603
4172026-06-24T04:44:38.357ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = a82f25bb-1de2-45a8-b222-bbc959ce80ca producer_ip = fd00:1122:3344:101::2 producer_port = 35101
4182026-06-24T04:44:38.357ZDEBGoximeter (collection-task): reporting oximeter self-collection statistics collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4192026-06-24T04:44:38.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = a82f25bb-1de2-45a8-b222-bbc959ce80ca producer_ip = fd00:1122:3344:101::2 producer_port = 35101
4202026-06-24T04:44:38.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = a82f25bb-1de2-45a8-b222-bbc959ce80ca producer_ip = fd00:1122:3344:101::2 producer_port = 35101
4212026-06-24T04:44:38.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4222026-06-24T04:44:38.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4232026-06-24T04:44:38.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 36 producer_id = a82f25bb-1de2-45a8-b222-bbc959ce80ca producer_ip = fd00:1122:3344:101::2 producer_port = 35101
4242026-06-24T04:44:38.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4252026-06-24T04:44:39.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4262026-06-24T04:44:39.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4272026-06-24T04:44:39.360ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4282026-06-24T04:44:40.124ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 168
4292026-06-24T04:44:40.124ZDEBGoximeter (clickhouse-client): unrolling 168 total samples collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
4302026-06-24T04:44:40.124ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 168
4312026-06-24T04:44:40.129ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
4322026-06-24T04:44:40.135ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 24 table_name = fields_i16
4332026-06-24T04:44:40.137ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 4 table_name = fields_ipaddr
4342026-06-24T04:44:40.139ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 172 table_name = fields_string
4352026-06-24T04:44:40.140ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 16 table_name = fields_u16
4362026-06-24T04:44:40.143ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 24 table_name = fields_u32
4372026-06-24T04:44:40.144ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 12 table_name = fields_u8
4382026-06-24T04:44:40.145ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 92 table_name = fields_uuid
4392026-06-24T04:44:40.146ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 138 table_name = measurements_cumulativeu64
4402026-06-24T04:44:40.148ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 30 table_name = measurements_u64
4412026-06-24T04:44:40.225ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
4422026-06-24T04:44:40.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4432026-06-24T04:44:40.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4442026-06-24T04:44:40.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4452026-06-24T04:44:41.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4462026-06-24T04:44:41.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4472026-06-24T04:44:41.360ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4482026-06-24T04:44:42.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4492026-06-24T04:44:42.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4502026-06-24T04:44:42.360ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4512026-06-24T04:44:43.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4522026-06-24T04:44:43.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4532026-06-24T04:44:43.361ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4542026-06-24T04:44:44.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4552026-06-24T04:44:44.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4562026-06-24T04:44:44.361ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4572026-06-24T04:44:45.124ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
4582026-06-24T04:44:45.124ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
4592026-06-24T04:44:45.124ZDEBGoximeter (clickhouse-client): unrolling 130 total samples collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
4602026-06-24T04:44:45.128ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
4612026-06-24T04:44:45.133ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 50 table_name = fields_string
4622026-06-24T04:44:45.134ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 52 table_name = fields_uuid
4632026-06-24T04:44:45.135ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 100 table_name = measurements_cumulativeu64
4642026-06-24T04:44:45.137ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 30 table_name = measurements_u64
4652026-06-24T04:44:45.225ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
4662026-06-24T04:44:45.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4672026-06-24T04:44:45.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4682026-06-24T04:44:45.360ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4692026-06-24T04:44:46.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4702026-06-24T04:44:46.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4712026-06-24T04:44:46.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4722026-06-24T04:44:47.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4732026-06-24T04:44:47.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4742026-06-24T04:44:47.360ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4752026-06-24T04:44:48.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4762026-06-24T04:44:48.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4772026-06-24T04:44:48.361ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4782026-06-24T04:44:49.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4792026-06-24T04:44:49.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4802026-06-24T04:44:49.362ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4812026-06-24T04:44:50.124ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
4822026-06-24T04:44:50.124ZDEBGoximeter (database-inserter): inserting samples into database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_samples = 130
4832026-06-24T04:44:50.124ZDEBGoximeter (clickhouse-client): unrolling 130 total samples collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
4842026-06-24T04:44:50.129ZDEBGoximeter (clickhouse-client): fetching timeseries schema from database collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994
4852026-06-24T04:44:50.134ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 50 table_name = fields_string
4862026-06-24T04:44:50.135ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 52 table_name = fields_uuid
4872026-06-24T04:44:50.137ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 100 table_name = measurements_cumulativeu64
4882026-06-24T04:44:50.138ZDEBGoximeter (clickhouse-client): inserted rows into table collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d id = af193533-7031-41da-aa01-6ea0cef51994 n_rows = 30 table_name = measurements_u64
4892026-06-24T04:44:50.225ZWARNoximeter (database-inserter): failed to insert some results into metric DB collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d error = Failed to check out connection to database: No backends found for this service file = oximeter/collector/src/results_sink.rs:269
4902026-06-24T04:44:50.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4912026-06-24T04:44:50.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4922026-06-24T04:44:50.360ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4932026-06-24T04:44:51.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4942026-06-24T04:44:51.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4952026-06-24T04:44:51.360ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4962026-06-24T04:44:52.357ZDEBGoximeter (collection-task): sent timer-based collection request to the collection task collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4972026-06-24T04:44:52.357ZDEBGoximeter (collection-task): collecting from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001
4982026-06-24T04:44:52.359ZDEBGoximeter (collection-task): collected results from producer collector_id = 3644ccd5-3d06-4276-907c-a58b9b7d5591 collector_ip = fd00:1122:3344:101::d n_results = 1 n_samples = 26 producer_id = 291556d0-fe2a-4212-b80c-cfbc21f5c160 producer_ip = fd00:1122:3344:101::1 producer_port = 8001