Max level shown:
1 [ May 21 17:25:04 Disabled. ]
2 [ May 21 17:25:04 Rereading configuration. ]
3 [ May 21 17:25:05 Enabled. ]
4 [ May 21 17:25:05 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/mgd/pkg/mgd_method_script.sh &"). ]
5 [ May 21 17:25:05 Method "start" exited with status 0. ]
6 [ May 21 17:25:05 Rereading configuration. ]
7 [ May 21 17:25:05 Executing refresh method ("/opt/oxide/mgd/pkg/refresh_ctrun_child.sh -c 211"). ]
8 + CONTRACT=''
9 + getopts c: o
10 + CONTRACT=211
11 + getopts c: o
12 + [[ -n 211 ]]
13 + pgrep -c 211
14 + PARENT_PID=2281
15 + [[ -n 2281 ]]
16 + pgrep -P 2281
17 + CHILD_PID=2282
18 + [[ -n 2282 ]]
19 + kill -USR1 2282
20 [ May 21 17:25:05 Method "refresh" exited with status 0. ]
21 [ May 21 17:25:05 Stopping because all processes in service exited. ]
22 [ May 21 17:25:05 Executing stop method (:kill). ]
23 [ May 21 17:25:06 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/mgd/pkg/mgd_method_script.sh &"). ]
24 [ May 21 17:25:06 Method "start" exited with status 0. ]
252026-05-21T17:25:06.057ZINFOslog-rs (mgd): signal handler waiting for context module = admin unit = signal
262026-05-21T17:25:06.076ZINFOslog-rs (mgd): interface monitor started module = unnumbered manager unit = daemon
272026-05-21T17:25:06.077ZINFOslog-rs (bgp): dispatcher started module = neighbor unit = dispatcher
282026-05-21T17:25:06.077ZINFOslog-rs (bgp): starting listener with bind arg: [::]:179 module = neighbor unit = dispatcher
292026-05-21T17:25:06.077ZINFOslog-rs (bgp): TcpListener created listener = TcpListener { addr: [::]:179, fd: 10 } module = neighbor unit = dispatcher
302026-05-21T17:25:06.077ZINFOslog-rs (bgp): transitioning to accept loop bind_addr = [::]:179 module = neighbor unit = dispatcher
312026-05-21T17:25:06.077ZINFOslog-rs (mgd): signal handler got context module = admin unit = signal
322026-05-21T17:25:06.079ZINFOslog-rs (mgd): starting bgp routers: {} module = admin unit = daemon
332026-05-21T17:25:06.079ZDEBGslog-rs: client request body = None method = GET unit = gateway-client uri = http://[::1]:12225/local/switch-id
342026-05-21T17:25:06.079ZINFOslog-rs (mgd): starting bfd sessions: [] module = admin unit = daemon
352026-05-21T17:25:06.080ZERROslog-rs (mgd): failed to start stats server: underlay address not found error = underlay address not found module = admin params = hostname oxz_switch, rack dbf67ffe-cf3f-44ed-b503-979e75ebd2d9, sled abfc807c-8485-4e2a-b1a5-e30ecd4f3926 unit = daemon
362026-05-21T17:25:06.080ZDEBGslog-rs: client response result = Err(reqwest::Error { kind: Request, url: "http://[::1]:12225/local/switch-id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:12225, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) }) unit = gateway-client
372026-05-21T17:25:06.080ZERROslog-rs: failed to resolve switch slot error = Communication Error: error sending request for url (http://[::1]:12225/local/switch-id)
382026-05-21T17:25:06.081ZWARNslog-rs (mg-lower): failed to ensure TEP address fde7:90e2:ade8:d8d4::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fde7:90e2:ade8:d8d4::1 unit = dpd
392026-05-21T17:25:06.082ZINFOslog-rs: listening on [::]:4676
402026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bestpath/config/fanout unit = api_server versions = all ending with 2.0.0
412026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bestpath/config/fanout unit = api_server versions = all ending with 2.0.0
422026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bfd/peers unit = api_server versions = all
432026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bfd/peers unit = api_server versions = all
442026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bfd/peers/{addr} unit = api_server versions = all
452026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/clear/neighbor unit = api_server versions = all starting from 4.0.0
462026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/clear/neighbor unit = api_server versions = all ending with 4.0.0
472026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/clear/unnumbered-neighbor unit = api_server versions = all starting from 5.0.0
482026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/checker unit = api_server versions = all
492026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/checker unit = api_server versions = all
502026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/checker unit = api_server versions = all
512026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/checker unit = api_server versions = all
522026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/neighbor unit = api_server versions = from 4.0.0 to 5.0.0
532026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/neighbor unit = api_server versions = all ending with 4.0.0
542026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbor unit = api_server versions = from 4.0.0 to 5.0.0
552026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbor unit = api_server versions = all ending with 4.0.0
562026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/neighbor unit = api_server versions = all starting from 8.0.0
572026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/neighbor unit = api_server versions = from 5.0.0 to 8.0.0
582026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/neighbor unit = api_server versions = from 4.0.0 to 5.0.0
592026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/neighbor unit = api_server versions = all ending with 4.0.0
602026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/neighbor unit = api_server versions = all starting from 8.0.0
612026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/neighbor unit = api_server versions = from 5.0.0 to 8.0.0
622026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/neighbor unit = api_server versions = from 4.0.0 to 5.0.0
632026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/neighbor unit = api_server versions = all ending with 4.0.0
642026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/neighbor/{asn}/{peer} unit = api_server versions = all starting from 8.0.0
652026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/neighbor/{asn}/{peer} unit = api_server versions = from 5.0.0 to 8.0.0
662026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbor/{asn}/{peer} unit = api_server versions = all starting from 8.0.0
672026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbor/{asn}/{peer} unit = api_server versions = from 5.0.0 to 8.0.0
682026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbors unit = api_server versions = from 4.0.0 to 5.0.0
692026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbors unit = api_server versions = all ending with 4.0.0
702026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbors/{asn} unit = api_server versions = all starting from 8.0.0
712026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbors/{asn} unit = api_server versions = from 5.0.0 to 8.0.0
722026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/origin4 unit = api_server versions = all
732026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/origin4 unit = api_server versions = all
742026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/origin4 unit = api_server versions = all
752026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/origin4 unit = api_server versions = all
762026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/origin6 unit = api_server versions = all starting from 2.0.0
772026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/origin6 unit = api_server versions = all starting from 2.0.0
782026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/origin6 unit = api_server versions = all starting from 2.0.0
792026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/origin6 unit = api_server versions = all starting from 2.0.0
802026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/router unit = api_server versions = all
812026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/router unit = api_server versions = all
822026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/router unit = api_server versions = all
832026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/router unit = api_server versions = all
842026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/routers unit = api_server versions = all
852026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/shaper unit = api_server versions = all
862026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/shaper unit = api_server versions = all
872026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/shaper unit = api_server versions = all
882026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/shaper unit = api_server versions = all
892026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = all starting from 8.0.0
902026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = from 5.0.0 to 8.0.0
912026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = all starting from 8.0.0
922026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = from 5.0.0 to 8.0.0
932026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = all starting from 8.0.0
942026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = from 5.0.0 to 8.0.0
952026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = all starting from 8.0.0
962026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = from 5.0.0 to 8.0.0
972026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/unnumbered-neighbors unit = api_server versions = all starting from 8.0.0
982026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/unnumbered-neighbors unit = api_server versions = from 5.0.0 to 8.0.0
992026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/history/fsm unit = api_server versions = all starting from 5.0.0
1002026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/history/fsm unit = api_server versions = from 2.0.0 to 5.0.0
1012026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/history/message unit = api_server versions = all starting from 5.0.0
1022026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/history/message unit = api_server versions = from 2.0.0 to 5.0.0
1032026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/message-history unit = api_server versions = all ending with 2.0.0
1042026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/omicron/apply unit = api_server versions = all starting from 8.0.0
1052026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/omicron/apply unit = api_server versions = from 4.0.0 to 8.0.0
1062026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/omicron/apply unit = api_server versions = all ending with 4.0.0
1072026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/exported unit = api_server versions = all starting from 6.0.0
1082026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/exported unit = api_server versions = from 5.0.0 to 6.0.0
1092026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/exported unit = api_server versions = all ending with 5.0.0
1102026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/imported unit = api_server versions = all ending with 2.0.0
1112026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/neighbors unit = api_server versions = all starting from 5.0.0
1122026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/neighbors unit = api_server versions = from 4.0.0 to 5.0.0
1132026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/neighbors unit = api_server versions = from 2.0.0 to 4.0.0
1142026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/neighbors unit = api_server versions = all ending with 2.0.0
1152026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/selected unit = api_server versions = all ending with 2.0.0
1162026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /ndp/interface unit = api_server versions = all starting from 5.0.0
1172026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /ndp/interfaces unit = api_server versions = all starting from 5.0.0
1182026-05-21T17:25:06.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /ndp/manager unit = api_server versions = all starting from 5.0.0
1192026-05-21T17:25:06.083ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /rib/config/bestpath/fanout unit = api_server versions = all starting from 2.0.0
1202026-05-21T17:25:06.083ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /rib/config/bestpath/fanout unit = api_server versions = all starting from 2.0.0
1212026-05-21T17:25:06.083ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /rib/status/imported unit = api_server versions = all starting from 5.0.0
1222026-05-21T17:25:06.083ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /rib/status/imported unit = api_server versions = from 2.0.0 to 5.0.0
1232026-05-21T17:25:06.083ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /rib/status/selected unit = api_server versions = all starting from 5.0.0
1242026-05-21T17:25:06.083ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /rib/status/selected unit = api_server versions = from 2.0.0 to 5.0.0
1252026-05-21T17:25:06.083ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /static/route4 unit = api_server versions = all
1262026-05-21T17:25:06.083ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /static/route4 unit = api_server versions = all
1272026-05-21T17:25:06.083ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /static/route4 unit = api_server versions = all
1282026-05-21T17:25:06.083ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /static/route6 unit = api_server versions = all starting from 2.0.0
1292026-05-21T17:25:06.083ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /static/route6 unit = api_server versions = all starting from 2.0.0
1302026-05-21T17:25:06.083ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /static/route6 unit = api_server versions = all starting from 2.0.0
1312026-05-21T17:25:06.083ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /switch/identifiers unit = api_server versions = all starting from 3.0.0
1322026-05-21T17:25:06.083ZINFOslog-rs (mgd): listening local_addr = [::]:4676 module = admin unit = api_server
1332026-05-21T17:25:06.083ZDEBGslog-rs (mgd): successfully registered DTrace USDT probes local_addr = [::]:4676 module = admin unit = api_server
1342026-05-21T17:25:06.083ZINFOslog-rs: admin: server started
1352026-05-21T17:25:07.082ZWARNslog-rs (mg-lower): failed to ensure TEP address fde7:90e2:ade8:d8d4::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fde7:90e2:ade8:d8d4::1 unit = dpd
1362026-05-21T17:25:08.082ZWARNslog-rs (mg-lower): failed to ensure TEP address fde7:90e2:ade8:d8d4::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fde7:90e2:ade8:d8d4::1 unit = dpd
1372026-05-21T17:25:09.082ZWARNslog-rs (mg-lower): failed to ensure TEP address fde7:90e2:ade8:d8d4::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fde7:90e2:ade8:d8d4::1 unit = dpd
1382026-05-21T17:25:10.083ZWARNslog-rs (mg-lower): failed to ensure TEP address fde7:90e2:ade8:d8d4::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fde7:90e2:ade8:d8d4::1 unit = dpd
1392026-05-21T17:25:11.083ZWARNslog-rs (mg-lower): failed to ensure TEP address fde7:90e2:ade8:d8d4::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fde7:90e2:ade8:d8d4::1 unit = dpd
1402026-05-21T17:25:12.146ZWARNslog-rs (mg-lower): failed to ensure TEP address fde7:90e2:ade8:d8d4::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fde7:90e2:ade8:d8d4::1 unit = dpd
1412026-05-21T17:25:13.146ZWARNslog-rs (mg-lower): failed to ensure TEP address fde7:90e2:ade8:d8d4::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fde7:90e2:ade8:d8d4::1 unit = dpd
1422026-05-21T17:25:14.147ZWARNslog-rs (mg-lower): failed to ensure TEP address fde7:90e2:ade8:d8d4::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fde7:90e2:ade8:d8d4::1 unit = dpd
1432026-05-21T17:25:15.147ZWARNslog-rs (mg-lower): failed to ensure TEP address fde7:90e2:ade8:d8d4::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fde7:90e2:ade8:d8d4::1 unit = dpd
1442026-05-21T17:25:16.081ZDEBGslog-rs: client request body = None method = GET unit = gateway-client uri = http://[::1]:12225/local/switch-id
1452026-05-21T17:25:16.081ZDEBGslog-rs: client response result = Err(reqwest::Error { kind: Request, url: "http://[::1]:12225/local/switch-id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:12225, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) }) unit = gateway-client
1462026-05-21T17:25:16.081ZERROslog-rs: failed to resolve switch slot error = Communication Error: error sending request for url (http://[::1]:12225/local/switch-id)
1472026-05-21T17:25:16.147ZWARNslog-rs (mg-lower): failed to ensure TEP address fde7:90e2:ade8:d8d4::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fde7:90e2:ade8:d8d4::1 unit = dpd
148 [ May 21 17:25:17 Rereading configuration. ]
149 [ May 21 17:25:17 Executing refresh method ("/opt/oxide/mgd/pkg/refresh_ctrun_child.sh -c 217"). ]
150 + CONTRACT=''
151 + getopts c: o
152 + CONTRACT=217
153 + getopts c: o
154 + [[ -n 217 ]]
155 + pgrep -c 217
156 + PARENT_PID=2312
157 + [[ -n 2312 ]]
158 + pgrep -P 2312
159 + CHILD_PID=2313
160 + [[ -n 2313 ]]
161 + kill -USR1 2313
1622026-05-21T17:25:17.377ZINFOslog-rs (mgd): handling smf refresh module = admin unit = smf
1632026-05-21T17:25:17.379ZINFOslog-rs (mgd): starting stats server on smf refresh module = admin unit = smf
164 [ May 21 17:25:17 Method "refresh" exited with status 0. ]
1652026-05-21T17:25:17.379ZINFOslog-rs (mgd): started stats server on smf refresh module = admin unit = smf
166 May 21 17:25:17.379 DEBG registered DTrace probes
167 May 21 17:25:17.380 DEBG registered endpoint, versions: all, path: /{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot
168 May 21 17:25:17.380 INFO listening, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328
169 May 21 17:25:17.380 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot
170 May 21 17:25:17.380 DEBG Nexus IP not provided, will use DNS to resolve it
171 May 21 17:25:17.380 INFO new DNS resolver, addresses: [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53], component: internal-dns-resolver, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/dfcd9ac/internal-dns/resolver/src/resolver.rs:144
172 May 21 17:25:17.381 DEBG starting producer registration task
173 May 21 17:25:17.381 INFO starting oximeter metric producer server, interval: 1s, address: [fd00:1122:3344:101::2]:4677, producer_id: 160234f1-2ef3-475c-bfa9-098c4dbb1d67, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/dfcd9ac/oximeter/producer/src/lib.rs:283
174 May 21 17:25:17.381 DEBG registering as oximeter producer with Nexus, registration_count: 0, component: producer-registration-task
1752026-05-21T17:25:17.691ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:38962 unit = api_server
1762026-05-21T17:25:17.691ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = PUT module = admin remote_addr = [fd00:1122:3344:101::1]:38962 req_id = 1437a2c5-3d63-4ce5-bc78-7ebad7334f22 unit = api_server uri = /static/route4 version = 8.0.0
1772026-05-21T17:25:17.692ZINFOslog-rs (mgd): request completed latency_us = 837 local_addr = [::]:4676 method = PUT module = admin remote_addr = [fd00:1122:3344:101::1]:38962 req_id = 1437a2c5-3d63-4ce5-bc78-7ebad7334f22 response_code = 204 unit = api_server uri = /static/route4
1782026-05-21T17:25:17.692ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = PUT module = admin remote_addr = [fd00:1122:3344:101::1]:38962 req_id = bbf478e8-7252-4b16-aef0-7416165f7e75 unit = api_server uri = /static/route6 version = 8.0.0
1792026-05-21T17:25:17.692ZINFOslog-rs (mgd): request completed latency_us = 177 local_addr = [::]:4676 method = PUT module = admin remote_addr = [fd00:1122:3344:101::1]:38962 req_id = bbf478e8-7252-4b16-aef0-7416165f7e75 response_code = 204 unit = api_server uri = /static/route6
1802026-05-21T17:25:17.693ZERROslog-rs (mg-lower): handling change failed: route lookup error io error No such process (os error 3) error = route lookup error io error No such process (os error 3) module = sync unit = event_loop
1812026-05-21T17:25:17.693ZINFOslog-rs (mg-lower): restarting sync loop module = sync unit = event_loop
182 May 21 17:25:22.384 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4293e544-786a-4af2-b3a6-5728a59a8e82.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("51e68294-d94a-4054-b8d8-62ce4a985f97.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("70795b77-37cd-4507-8781-f972334cb32a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("70795b77-37cd-4507-8781-f972334cb32a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 801, tv_nsec: 416295684 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
183 May 21 17:25:22.385 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
184 May 21 17:25:22.386 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
1852026-05-21T17:25:26.082ZDEBGslog-rs: client request body = None method = GET unit = gateway-client uri = http://[::1]:12225/local/switch-id
1862026-05-21T17:25:26.083ZDEBGslog-rs: client response result = Ok(Response { url: "http://[::1]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "02b6cd49-0ed0-48ee-b64e-0a1da6d42104", "content-length": "26", "date": "Thu, 21 May 2026 17:25:26 GMT"} }) unit = gateway-client
1872026-05-21T17:25:26.083ZINFOslog-rs: we are in switch slot 0
188 May 21 17:25:36.715 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
189 May 21 17:25:36.715 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 20.006681565s, count: 0, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/dfcd9ac/oximeter/producer/src/lib.rs:379
190 May 21 17:25:37.031 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4293e544-786a-4af2-b3a6-5728a59a8e82.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("51e68294-d94a-4054-b8d8-62ce4a985f97.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("70795b77-37cd-4507-8781-f972334cb32a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("70795b77-37cd-4507-8781-f972334cb32a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 816, tv_nsec: 735380715 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
191 May 21 17:25:37.032 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
192 May 21 17:25:37.033 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
193 May 21 17:25:52.076 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
194 May 21 17:25:52.076 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 35.325597839s, count: 1, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/dfcd9ac/oximeter/producer/src/lib.rs:379
195 May 21 17:25:52.747 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4293e544-786a-4af2-b3a6-5728a59a8e82.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("51e68294-d94a-4054-b8d8-62ce4a985f97.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("70795b77-37cd-4507-8781-f972334cb32a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("70795b77-37cd-4507-8781-f972334cb32a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 832, tv_nsec: 407895662 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
196 May 21 17:25:52.747 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
197 May 21 17:25:52.748 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
198 May 21 17:26:07.791 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
199 May 21 17:26:07.791 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 50.997144424s, count: 2, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/dfcd9ac/oximeter/producer/src/lib.rs:379
200 May 21 17:26:08.812 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4293e544-786a-4af2-b3a6-5728a59a8e82.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("51e68294-d94a-4054-b8d8-62ce4a985f97.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("70795b77-37cd-4507-8781-f972334cb32a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("70795b77-37cd-4507-8781-f972334cb32a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 848, tv_nsec: 429018988 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
201 May 21 17:26:08.813 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
202 May 21 17:26:08.813 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
203 May 21 17:26:23.855 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
204 May 21 17:26:23.856 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 67.018586913s, count: 3, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/dfcd9ac/oximeter/producer/src/lib.rs:379
205 May 21 17:26:25.228 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4293e544-786a-4af2-b3a6-5728a59a8e82.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("51e68294-d94a-4054-b8d8-62ce4a985f97.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("70795b77-37cd-4507-8781-f972334cb32a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("70795b77-37cd-4507-8781-f972334cb32a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 864, tv_nsec: 800532007 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
206 May 21 17:26:25.229 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
207 May 21 17:26:25.229 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
208 May 21 17:26:40.271 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
209 May 21 17:26:40.271 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 83.389502352s, count: 4, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/dfcd9ac/oximeter/producer/src/lib.rs:379
210 May 21 17:26:45.354 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4293e544-786a-4af2-b3a6-5728a59a8e82.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("51e68294-d94a-4054-b8d8-62ce4a985f97.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("70795b77-37cd-4507-8781-f972334cb32a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("70795b77-37cd-4507-8781-f972334cb32a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 884, tv_nsec: 872048781 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
211 May 21 17:26:45.355 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
212 May 21 17:26:45.355 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
213 May 21 17:27:00.394 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
214 May 21 17:27:00.640 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 103.461730778s, count: 5, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/dfcd9ac/oximeter/producer/src/lib.rs:379
215 May 21 17:27:11.435 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4293e544-786a-4af2-b3a6-5728a59a8e82.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("51e68294-d94a-4054-b8d8-62ce4a985f97.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("70795b77-37cd-4507-8781-f972334cb32a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("70795b77-37cd-4507-8781-f972334cb32a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 910, tv_nsec: 915239642 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
216 May 21 17:27:11.435 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
217 May 21 17:27:11.437 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
218 May 21 17:27:26.439 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
219 May 21 17:27:26.439 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 129.506136501s, count: 6, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/dfcd9ac/oximeter/producer/src/lib.rs:379
220 May 21 17:27:41.157 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4293e544-786a-4af2-b3a6-5728a59a8e82.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("51e68294-d94a-4054-b8d8-62ce4a985f97.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("70795b77-37cd-4507-8781-f972334cb32a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("70795b77-37cd-4507-8781-f972334cb32a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 940, tv_nsec: 637380491 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
221 May 21 17:27:41.158 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
222 May 21 17:27:41.159 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
223 May 21 17:27:57.061 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
224 May 21 17:27:57.199 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 160.11688432s, count: 7, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/dfcd9ac/oximeter/producer/src/lib.rs:379
225 May 21 17:28:14.499 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4293e544-786a-4af2-b3a6-5728a59a8e82.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("51e68294-d94a-4054-b8d8-62ce4a985f97.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("70795b77-37cd-4507-8781-f972334cb32a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("70795b77-37cd-4507-8781-f972334cb32a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 973, tv_nsec: 973136920 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
226 May 21 17:28:14.504 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
227 May 21 17:28:14.530 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
228 May 21 17:28:15.813 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::c]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) }), component: producer-registration-task
229 May 21 17:28:15.813 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): client error (Connect): tcp connect error: Connection refused (os error 146), delay: 178.879103791s, count: 8, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/dfcd9ac/oximeter/producer/src/lib.rs:379
2302026-05-21T17:28:32.782ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::c]:47601 unit = api_server
2312026-05-21T17:28:32.788ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::a]:35718 unit = api_server
2322026-05-21T17:28:32.796ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:47601 req_id = 631ba230-239c-4fe5-b949-ad0d9b2badf3 unit = api_server uri = /switch/identifiers version = 8.0.0
2332026-05-21T17:28:32.796ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:35718 req_id = 2bea6fef-ba4f-455b-b2b0-43a5220f471b unit = api_server uri = /switch/identifiers version = 8.0.0
2342026-05-21T17:28:32.809ZINFOslog-rs (mgd): request completed latency_us = 19557 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:47601 req_id = 631ba230-239c-4fe5-b949-ad0d9b2badf3 response_code = 200 unit = api_server uri = /switch/identifiers
2352026-05-21T17:28:32.809ZINFOslog-rs (mgd): request completed latency_us = 19556 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:35718 req_id = 2bea6fef-ba4f-455b-b2b0-43a5220f471b response_code = 200 unit = api_server uri = /switch/identifiers
2362026-05-21T17:28:32.810ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:35718 req_id = 7ee3d729-db43-4e56-ba5d-427e0a7f1e50 unit = api_server uri = /bfd/peers version = 8.0.0
2372026-05-21T17:28:32.810ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:47601 req_id = 84c3b5e3-52ff-4f02-aad8-8c1962ae694b unit = api_server uri = /bfd/peers version = 8.0.0
2382026-05-21T17:28:32.811ZINFOslog-rs (mgd): request completed latency_us = 954 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:47601 req_id = 84c3b5e3-52ff-4f02-aad8-8c1962ae694b response_code = 200 unit = api_server uri = /bfd/peers
2392026-05-21T17:28:32.812ZINFOslog-rs (mgd): request completed latency_us = 1667 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:35718 req_id = 7ee3d729-db43-4e56-ba5d-427e0a7f1e50 response_code = 200 unit = api_server uri = /bfd/peers
2402026-05-21T17:28:32.841ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::b]:52777 unit = api_server
2412026-05-21T17:28:32.841ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:52777 req_id = 87097f64-ac70-45c5-ad81-ecc687ca0d3f unit = api_server uri = /switch/identifiers version = 8.0.0
2422026-05-21T17:28:32.841ZINFOslog-rs (mgd): request completed latency_us = 67 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:52777 req_id = 87097f64-ac70-45c5-ad81-ecc687ca0d3f response_code = 200 unit = api_server uri = /switch/identifiers
2432026-05-21T17:28:32.842ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:52777 req_id = 459da477-476d-473c-b43d-024e2a08553a unit = api_server uri = /bfd/peers version = 8.0.0
2442026-05-21T17:28:32.842ZINFOslog-rs (mgd): request completed latency_us = 80 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:52777 req_id = 459da477-476d-473c-b43d-024e2a08553a response_code = 200 unit = api_server uri = /bfd/peers
2452026-05-21T17:29:02.656ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::c]:50633 unit = api_server
2462026-05-21T17:29:02.656ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:50633 req_id = 84050808-cdd6-425c-a84a-0269f7f12d99 unit = api_server uri = /switch/identifiers version = 8.0.0
2472026-05-21T17:29:02.656ZINFOslog-rs (mgd): request completed latency_us = 69 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:50633 req_id = 84050808-cdd6-425c-a84a-0269f7f12d99 response_code = 200 unit = api_server uri = /switch/identifiers
2482026-05-21T17:29:02.656ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:50633 req_id = 1034239c-ece1-4683-9bfb-4c02c443c9f9 unit = api_server uri = /bfd/peers version = 8.0.0
2492026-05-21T17:29:02.656ZINFOslog-rs (mgd): request completed latency_us = 55 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:50633 req_id = 1034239c-ece1-4683-9bfb-4c02c443c9f9 response_code = 200 unit = api_server uri = /bfd/peers
2502026-05-21T17:29:02.658ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::a]:44558 unit = api_server
2512026-05-21T17:29:02.658ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:44558 req_id = 17d94cfb-2043-4f35-a690-42c5d1543d6b unit = api_server uri = /switch/identifiers version = 8.0.0
2522026-05-21T17:29:02.658ZINFOslog-rs (mgd): request completed latency_us = 42 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:44558 req_id = 17d94cfb-2043-4f35-a690-42c5d1543d6b response_code = 200 unit = api_server uri = /switch/identifiers
2532026-05-21T17:29:02.659ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:44558 req_id = 670de0ea-b526-4bd0-b1a9-10c68feef9a9 unit = api_server uri = /bfd/peers version = 8.0.0
2542026-05-21T17:29:02.659ZINFOslog-rs (mgd): request completed latency_us = 27 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:44558 req_id = 670de0ea-b526-4bd0-b1a9-10c68feef9a9 response_code = 200 unit = api_server uri = /bfd/peers
2552026-05-21T17:29:02.686ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::b]:37239 unit = api_server
2562026-05-21T17:29:02.686ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:37239 req_id = 18d06ddd-f8a9-4df8-a2f4-5254c2c7be15 unit = api_server uri = /switch/identifiers version = 8.0.0
2572026-05-21T17:29:02.687ZINFOslog-rs (mgd): request completed latency_us = 59 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:37239 req_id = 18d06ddd-f8a9-4df8-a2f4-5254c2c7be15 response_code = 200 unit = api_server uri = /switch/identifiers
2582026-05-21T17:29:02.687ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:37239 req_id = b10d92c0-7d6f-4cbe-99a9-45d6079df416 unit = api_server uri = /bfd/peers version = 8.0.0
2592026-05-21T17:29:02.687ZINFOslog-rs (mgd): request completed latency_us = 79 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:37239 req_id = b10d92c0-7d6f-4cbe-99a9-45d6079df416 response_code = 200 unit = api_server uri = /bfd/peers
2602026-05-21T17:29:02.700ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::c]:45885 unit = api_server
2612026-05-21T17:29:02.701ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:45885 req_id = e60dd04d-604d-4fb7-a5f3-47e285cca7fc unit = api_server uri = /switch/identifiers version = 8.0.0
2622026-05-21T17:29:02.701ZINFOslog-rs (mgd): request completed latency_us = 83 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:45885 req_id = e60dd04d-604d-4fb7-a5f3-47e285cca7fc response_code = 200 unit = api_server uri = /switch/identifiers
2632026-05-21T17:29:02.709ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::a]:41847 unit = api_server
2642026-05-21T17:29:02.711ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:41847 req_id = ff78ee3c-cb36-416f-9011-ae02b634ecbe unit = api_server uri = /switch/identifiers version = 8.0.0
2652026-05-21T17:29:02.711ZINFOslog-rs (mgd): request completed latency_us = 64 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:41847 req_id = ff78ee3c-cb36-416f-9011-ae02b634ecbe response_code = 200 unit = api_server uri = /switch/identifiers
2662026-05-21T17:29:02.729ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::b]:58502 unit = api_server
2672026-05-21T17:29:02.730ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:58502 req_id = 268e426e-83d9-423a-aaf3-00c50b268f8b unit = api_server uri = /switch/identifiers version = 8.0.0
2682026-05-21T17:29:02.730ZINFOslog-rs (mgd): request completed latency_us = 59 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:58502 req_id = 268e426e-83d9-423a-aaf3-00c50b268f8b response_code = 200 unit = api_server uri = /switch/identifiers
2692026-05-21T17:29:02.853ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:45885 req_id = 43fe871b-aeec-49b4-b888-d51668b3f663 unit = api_server uri = /static/route4 version = 8.0.0
2702026-05-21T17:29:02.878ZINFOslog-rs (mgd): request completed latency_us = 24794 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:45885 req_id = 43fe871b-aeec-49b4-b888-d51668b3f663 response_code = 200 unit = api_server uri = /static/route4
2712026-05-21T17:29:02.881ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:45885 req_id = 0cad4cdb-e6c6-4de0-a024-03dc65516183 unit = api_server uri = /static/route6 version = 8.0.0
2722026-05-21T17:29:02.882ZINFOslog-rs (mgd): request completed latency_us = 1030 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:45885 req_id = 0cad4cdb-e6c6-4de0-a024-03dc65516183 response_code = 200 unit = api_server uri = /static/route6
2732026-05-21T17:29:02.898ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:41847 req_id = 167e2d7a-e4a0-477b-a0c5-f3dd9b000363 unit = api_server uri = /static/route4 version = 8.0.0
2742026-05-21T17:29:02.898ZINFOslog-rs (mgd): request completed latency_us = 132 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:41847 req_id = 167e2d7a-e4a0-477b-a0c5-f3dd9b000363 response_code = 200 unit = api_server uri = /static/route4
2752026-05-21T17:29:02.901ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:41847 req_id = 1291f04a-b02d-4dbe-8252-64f090540b3b unit = api_server uri = /static/route6 version = 8.0.0
2762026-05-21T17:29:02.901ZINFOslog-rs (mgd): request completed latency_us = 96 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:41847 req_id = 1291f04a-b02d-4dbe-8252-64f090540b3b response_code = 200 unit = api_server uri = /static/route6
2772026-05-21T17:29:03.078ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:58502 req_id = e3627fa5-c65f-4ed7-859b-2797a710763f unit = api_server uri = /static/route4 version = 8.0.0
2782026-05-21T17:29:03.078ZINFOslog-rs (mgd): request completed latency_us = 89 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:58502 req_id = e3627fa5-c65f-4ed7-859b-2797a710763f response_code = 200 unit = api_server uri = /static/route4
2792026-05-21T17:29:03.081ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:58502 req_id = c80b0849-3e95-4822-a3f2-506d4350665b unit = api_server uri = /static/route6 version = 8.0.0
2802026-05-21T17:29:03.081ZINFOslog-rs (mgd): request completed latency_us = 74 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:58502 req_id = c80b0849-3e95-4822-a3f2-506d4350665b response_code = 200 unit = api_server uri = /static/route6
2812026-05-21T17:29:32.655ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::c]:57547 unit = api_server
2822026-05-21T17:29:32.655ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:57547 req_id = b254995d-7295-4066-a9ce-81b96acf2ef3 unit = api_server uri = /switch/identifiers version = 8.0.0
2832026-05-21T17:29:32.655ZINFOslog-rs (mgd): request completed latency_us = 45 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:57547 req_id = b254995d-7295-4066-a9ce-81b96acf2ef3 response_code = 200 unit = api_server uri = /switch/identifiers
2842026-05-21T17:29:32.655ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:57547 req_id = 96703cf4-d213-48e2-8e3b-993b528e735f unit = api_server uri = /bfd/peers version = 8.0.0
2852026-05-21T17:29:32.655ZINFOslog-rs (mgd): request completed latency_us = 62 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:57547 req_id = 96703cf4-d213-48e2-8e3b-993b528e735f response_code = 200 unit = api_server uri = /bfd/peers
2862026-05-21T17:29:32.657ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::a]:62065 unit = api_server
2872026-05-21T17:29:32.657ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:62065 req_id = 035e5773-69b0-4009-8aa6-9e965c1e1bc3 unit = api_server uri = /switch/identifiers version = 8.0.0
2882026-05-21T17:29:32.657ZINFOslog-rs (mgd): request completed latency_us = 27 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:62065 req_id = 035e5773-69b0-4009-8aa6-9e965c1e1bc3 response_code = 200 unit = api_server uri = /switch/identifiers
2892026-05-21T17:29:32.658ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:62065 req_id = 3bec710e-88be-45fa-954f-b645e21e64a1 unit = api_server uri = /bfd/peers version = 8.0.0
2902026-05-21T17:29:32.658ZINFOslog-rs (mgd): request completed latency_us = 34 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:62065 req_id = 3bec710e-88be-45fa-954f-b645e21e64a1 response_code = 200 unit = api_server uri = /bfd/peers
2912026-05-21T17:29:32.696ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::b]:43305 unit = api_server
2922026-05-21T17:29:32.696ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:43305 req_id = ff160d5c-bd7f-4a8a-a31a-f66e39f52580 unit = api_server uri = /switch/identifiers version = 8.0.0
2932026-05-21T17:29:32.696ZINFOslog-rs (mgd): request completed latency_us = 64 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:43305 req_id = ff160d5c-bd7f-4a8a-a31a-f66e39f52580 response_code = 200 unit = api_server uri = /switch/identifiers
2942026-05-21T17:29:32.696ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:43305 req_id = 6436c362-c0b0-43f0-bae0-3f6a44b58cf7 unit = api_server uri = /bfd/peers version = 8.0.0
2952026-05-21T17:29:32.696ZINFOslog-rs (mgd): request completed latency_us = 82 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:43305 req_id = 6436c362-c0b0-43f0-bae0-3f6a44b58cf7 response_code = 200 unit = api_server uri = /bfd/peers
2962026-05-21T17:29:32.710ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::a]:58488 unit = api_server
2972026-05-21T17:29:32.710ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:58488 req_id = 101b886e-5e4f-478b-9a7b-44b217dc2b52 unit = api_server uri = /switch/identifiers version = 8.0.0
2982026-05-21T17:29:32.710ZINFOslog-rs (mgd): request completed latency_us = 61 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:58488 req_id = 101b886e-5e4f-478b-9a7b-44b217dc2b52 response_code = 200 unit = api_server uri = /switch/identifiers
2992026-05-21T17:29:32.710ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::c]:41305 unit = api_server
3002026-05-21T17:29:32.710ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:41305 req_id = f15ae5dd-e696-40f0-ae86-08985f1c72a8 unit = api_server uri = /switch/identifiers version = 8.0.0
3012026-05-21T17:29:32.710ZINFOslog-rs (mgd): request completed latency_us = 53 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:41305 req_id = f15ae5dd-e696-40f0-ae86-08985f1c72a8 response_code = 200 unit = api_server uri = /switch/identifiers
3022026-05-21T17:29:32.720ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::b]:44198 unit = api_server
3032026-05-21T17:29:32.720ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:44198 req_id = 51eea766-7fcf-4ba9-858d-4681f39d3c0b unit = api_server uri = /switch/identifiers version = 8.0.0
3042026-05-21T17:29:32.720ZINFOslog-rs (mgd): request completed latency_us = 68 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:44198 req_id = 51eea766-7fcf-4ba9-858d-4681f39d3c0b response_code = 200 unit = api_server uri = /switch/identifiers
3052026-05-21T17:29:32.884ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:58488 req_id = 059089ee-6292-4182-a126-a93a144cc418 unit = api_server uri = /static/route4 version = 8.0.0
3062026-05-21T17:29:32.885ZINFOslog-rs (mgd): request completed latency_us = 129 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:58488 req_id = 059089ee-6292-4182-a126-a93a144cc418 response_code = 200 unit = api_server uri = /static/route4
3072026-05-21T17:29:32.885ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:58488 req_id = 63c60dbf-b1e0-48af-b879-b7e9637a4afb unit = api_server uri = /static/route6 version = 8.0.0
3082026-05-21T17:29:32.885ZINFOslog-rs (mgd): request completed latency_us = 89 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:58488 req_id = 63c60dbf-b1e0-48af-b879-b7e9637a4afb response_code = 200 unit = api_server uri = /static/route6
3092026-05-21T17:29:32.914ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:41305 req_id = 6701d793-54b0-4e8a-a467-00115bdc9ec1 unit = api_server uri = /static/route4 version = 8.0.0
3102026-05-21T17:29:32.914ZINFOslog-rs (mgd): request completed latency_us = 130 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:41305 req_id = 6701d793-54b0-4e8a-a467-00115bdc9ec1 response_code = 200 unit = api_server uri = /static/route4
3112026-05-21T17:29:32.914ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:41305 req_id = 020cfc37-5964-424c-9041-ea26361cdfc2 unit = api_server uri = /static/route6 version = 8.0.0
3122026-05-21T17:29:32.914ZINFOslog-rs (mgd): request completed latency_us = 113 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:41305 req_id = 020cfc37-5964-424c-9041-ea26361cdfc2 response_code = 200 unit = api_server uri = /static/route6
3132026-05-21T17:29:33.111ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:44198 req_id = 2c96e1a5-b8ff-4046-bf4f-cbd69011194e unit = api_server uri = /static/route4 version = 8.0.0
3142026-05-21T17:29:33.111ZINFOslog-rs (mgd): request completed latency_us = 117 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:44198 req_id = 2c96e1a5-b8ff-4046-bf4f-cbd69011194e response_code = 200 unit = api_server uri = /static/route4
3152026-05-21T17:29:33.112ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:44198 req_id = adde04c4-fe09-4160-8098-34fa9fdb28e3 unit = api_server uri = /static/route6 version = 8.0.0
3162026-05-21T17:29:33.112ZINFOslog-rs (mgd): request completed latency_us = 90 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:44198 req_id = adde04c4-fe09-4160-8098-34fa9fdb28e3 response_code = 200 unit = api_server uri = /static/route6
317 May 21 17:29:44.914 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4293e544-786a-4af2-b3a6-5728a59a8e82.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("51e68294-d94a-4054-b8d8-62ce4a985f97.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("70795b77-37cd-4507-8781-f972334cb32a.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("70795b77-37cd-4507-8781-f972334cb32a.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 1064, tv_nsec: 391645686 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
318 May 21 17:29:44.914 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
319 May 21 17:29:44.917 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
320 May 21 17:29:44.968 DEBG client response, result: Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "14999047-d8de-45f6-b25b-8aa03d09f03a", "content-length": "41", "date": "Thu, 21 May 2026 17:29:44 GMT"} }), component: producer-registration-task
321 May 21 17:29:44.968 DEBG successfully registered with Nexus, pausing until time to renew lease, wait_period: 150s, lease_duration: 600s, component: producer-registration-task
322 May 21 17:29:54.233 INFO accepted connection, remote_addr: [fd00:1122:3344:101::d]:49203, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:1025
323 May 21 17:29:54.240 INFO request completed, latency_us: 5511, response_code: 200, uri: /160234f1-2ef3-475c-bfa9-098c4dbb1d67, method: GET, req_id: a997ef9e-ed88-4624-8691-057806fc0b76, remote_addr: [fd00:1122:3344:101::d]:49203, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867
324 May 21 17:29:55.234 INFO request completed, latency_us: 335, response_code: 200, uri: /160234f1-2ef3-475c-bfa9-098c4dbb1d67, method: GET, req_id: 453ed5fa-8f72-47fd-90f8-61bc6ce4429c, remote_addr: [fd00:1122:3344:101::d]:49203, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867
325 May 21 17:29:56.233 INFO request completed, latency_us: 340, response_code: 200, uri: /160234f1-2ef3-475c-bfa9-098c4dbb1d67, method: GET, req_id: c1494a82-305b-4715-81b1-e08f9910514f, remote_addr: [fd00:1122:3344:101::d]:49203, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867
326 May 21 17:29:57.233 INFO request completed, latency_us: 371, response_code: 200, uri: /160234f1-2ef3-475c-bfa9-098c4dbb1d67, method: GET, req_id: 04f6c562-bfe1-4b70-b806-712990efc92d, remote_addr: [fd00:1122:3344:101::d]:49203, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867
327 May 21 17:29:58.233 INFO request completed, latency_us: 309, response_code: 200, uri: /160234f1-2ef3-475c-bfa9-098c4dbb1d67, method: GET, req_id: 3703d80b-c175-472e-bf4a-9877b849bf54, remote_addr: [fd00:1122:3344:101::d]:49203, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867
328 May 21 17:29:59.233 INFO request completed, latency_us: 336, response_code: 200, uri: /160234f1-2ef3-475c-bfa9-098c4dbb1d67, method: GET, req_id: f6128809-ca4b-47dd-a5ad-47f6ac9df851, remote_addr: [fd00:1122:3344:101::d]:49203, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867
329 May 21 17:30:00.233 INFO request completed, latency_us: 440, response_code: 200, uri: /160234f1-2ef3-475c-bfa9-098c4dbb1d67, method: GET, req_id: 38d9ec77-6bb9-4a1b-a9a6-2509bc8f9455, remote_addr: [fd00:1122:3344:101::d]:49203, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867
330 May 21 17:30:01.234 INFO request completed, latency_us: 463, response_code: 200, uri: /160234f1-2ef3-475c-bfa9-098c4dbb1d67, method: GET, req_id: 44b67a52-f482-48a3-b1b8-296a6b29d95a, remote_addr: [fd00:1122:3344:101::d]:49203, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867