Max level shown:
1 [ Jul 8 00:44:49 Enabled. ]
2 [ Jul 8 00:44:49 Rereading configuration. ]
3 [ Jul 8 00:44:50 Rereading configuration. ]
4 [ Jul 8 00:44:53 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/oximeter-collector/bin/oximeter run /var/svc/manifest/site/oximeter/config.toml --address [fd00:1122:3344:101::d]:12223 --id 966848da-ebae-47e5-8ea7-292193a7ff3f &"). ]
5 [ Jul 8 00:44:53 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72026-07-08T00:44:53.347ZDEBGoximeter: registered DTrace probes
82026-07-08T00:44:53.349ZINFOoximeter: starting oximeter server file = oximeter/collector/src/lib.rs:299
92026-07-08T00:44:53.350ZDEBGoximeter: creating ClickHouse client
102026-07-08T00:44:53.364ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 966848da-ebae-47e5-8ea7-292193a7ff3f collector_ip = fd00:1122:3344:101::d id = 5f7c8e36-b3cd-46e1-8bc3-748222116b9b
112026-07-08T00:44:58.072ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 966848da-ebae-47e5-8ea7-292193a7ff3f collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:888 id = 5f7c8e36-b3cd-46e1-8bc3-748222116b9b
122026-07-08T00:44:58.072ZDEBGoximeter (oximeter-agent): oximeter database does not exist, creating collector_id = 966848da-ebae-47e5-8ea7-292193a7ff3f collector_ip = fd00:1122:3344:101::d
132026-07-08T00:44:58.072ZINFOoximeter (clickhouse-client): reading db version collector_id = 966848da-ebae-47e5-8ea7-292193a7ff3f collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:788 id = 5f7c8e36-b3cd-46e1-8bc3-748222116b9b
142026-07-08T00:44:58.073ZWARNoximeter (clickhouse-client): oximeter database does not exist, or is out-of-date collector_id = 966848da-ebae-47e5-8ea7-292193a7ff3f collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:888 id = 5f7c8e36-b3cd-46e1-8bc3-748222116b9b
152026-07-08T00:44:58.073ZINFOoximeter (clickhouse-client): read oximeter database version collector_id = 966848da-ebae-47e5-8ea7-292193a7ff3f collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:793 id = 5f7c8e36-b3cd-46e1-8bc3-748222116b9b version = 0
162026-07-08T00:44:58.073ZINFOoximeter (clickhouse-client): initializing oximeter schema collector_id = 966848da-ebae-47e5-8ea7-292193a7ff3f collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:798 id = 5f7c8e36-b3cd-46e1-8bc3-748222116b9b
172026-07-08T00:44:58.073ZDEBGoximeter (clickhouse-client): initializing ClickHouse database collector_id = 966848da-ebae-47e5-8ea7-292193a7ff3f collector_ip = fd00:1122:3344:101::d id = 5f7c8e36-b3cd-46e1-8bc3-748222116b9b
182026-07-08T00:44:58.159ZINFOoximeter (clickhouse-client): inserting current version collector_id = 966848da-ebae-47e5-8ea7-292193a7ff3f collector_ip = fd00:1122:3344:101::d file = oximeter/db/src/client/mod.rs:819 id = 5f7c8e36-b3cd-46e1-8bc3-748222116b9b version = 14
192026-07-08T00:44:58.180ZDEBGoximeter (clickhouse-client): registered USDT probes collector_id = 966848da-ebae-47e5-8ea7-292193a7ff3f collector_ip = fd00:1122:3344:101::d id = 4f63655a-f349-472a-a7b0-26477d428ad1
202026-07-08T00:44:58.187ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /info versions = all
212026-07-08T00:44:58.187ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers versions = all
222026-07-08T00:44:58.187ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = DELETE path = /producers/{producer_id} versions = all
232026-07-08T00:44:58.187ZDEBGoximeter (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::d]:12223 method = GET path = /producers/{producer_id} versions = all
242026-07-08T00:44:58.187ZINFOoximeter (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:335 local_addr = [fd00:1122:3344:101::d]:12223
252026-07-08T00:44:58.190ZDEBGoximeter (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::d]:12223
262026-07-08T00:44:58.190ZDEBGoximeter: registered USDT probes
272026-07-08T00:44:58.190ZDEBGoximeter: contacting nexus
282026-07-08T00:44:58.210ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/collectors
292026-07-08T00:44:58.211ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::b]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
302026-07-08T00:44:58.211ZWARNoximeter: failed to contact nexus, will retry in 171.800281ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:444
312026-07-08T00:44:58.384ZDEBGoximeter: contacting nexus
322026-07-08T00:44:58.384ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
332026-07-08T00:44:58.385ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
342026-07-08T00:44:58.385ZWARNoximeter: failed to contact nexus, will retry in 476.665395ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:444
352026-07-08T00:44:58.862ZDEBGoximeter: contacting nexus
362026-07-08T00:44:58.862ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/collectors
372026-07-08T00:44:58.862ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::c]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
382026-07-08T00:44:58.862ZWARNoximeter: failed to contact nexus, will retry in 1.430393689s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:444
392026-07-08T00:45:00.294ZDEBGoximeter: contacting nexus
402026-07-08T00:45:00.295ZDEBGoximeter: client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/collectors
412026-07-08T00:45:00.295ZDEBGoximeter: client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/collectors", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
422026-07-08T00:45:00.295ZWARNoximeter: failed to contact nexus, will retry in 2.610777935s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/collectors)" file = oximeter/collector/src/lib.rs:444