Max level shown:
1 [ Aug 25 09:26:00 Disabled. ]
2 [ Aug 25 09:26:00 Rereading configuration. ]
3 [ Aug 25 09:26:00 Enabled. ]
4 [ Aug 25 09:26:00 Rereading configuration. ]
5 [ Aug 25 09:26:01 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/mgd/pkg/mgd_method_script.sh &"). ]
6 [ Aug 25 09:26:01 Method "start" exited with status 0. ]
72026-08-25T09:26:01.055ZINFOslog-rs (mgd): signal handler waiting for context module = admin unit = signal
82026-08-25T09:26:01.074ZINFOslog-rs (mgd): interface monitor started module = unnumbered manager unit = daemon
92026-08-25T09:26:01.074ZINFOslog-rs (bgp): dispatcher started module = neighbor unit = dispatcher
102026-08-25T09:26:01.074ZINFOslog-rs (bgp): starting listener with bind arg: [::]:179 module = neighbor unit = dispatcher
112026-08-25T09:26:01.074ZINFOslog-rs (bgp): TcpListener created listener = TcpListener { addr: [::]:179, fd: 10 } module = neighbor unit = dispatcher
122026-08-25T09:26:01.074ZINFOslog-rs (bgp): transitioning to accept loop bind_addr = [::]:179 module = neighbor unit = dispatcher
132026-08-25T09:26:01.074ZINFOslog-rs (mgd): signal handler got context module = admin unit = signal
142026-08-25T09:26:01.077ZDEBGslog-rs: client request body = None method = GET unit = gateway-client uri = http://[::1]:12225/local/switch-id
152026-08-25T09:26:01.077ZDEBGslog-rs: client response result = Err(reqwest::Error { kind: Request, url: "http://[::1]:12225/local/switch-id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:12225, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) }) unit = gateway-client
162026-08-25T09:26:01.078ZERROslog-rs: failed to resolve switch slot error = Communication Error: error sending request for url (http://[::1]:12225/local/switch-id)
172026-08-25T09:26:01.078ZINFOslog-rs (mgd): starting bgp routers: {} module = admin unit = daemon
182026-08-25T09:26:01.078ZINFOslog-rs (mgd): starting bfd sessions: [] module = admin unit = daemon
192026-08-25T09:26:01.079ZERROslog-rs (mgd): failed to start stats server: underlay address not found error = underlay address not found module = admin params = hostname oxz_switch, rack 74dd8fff-d599-4091-9a7b-8739786fd19a, sled bc97a796-b2a3-4844-8f8e-393ba2a16e3c unit = daemon
202026-08-25T09:26:01.079ZWARNslog-rs (mg-lower): failed to ensure TEP address fd9a:306e:6720:3c93::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd9a:306e:6720:3c93::1 unit = dpd
212026-08-25T09:26:01.079ZERROslog-rs: MRIB full sync failed: failed to get DDM multicast groups: Communication Error: error sending request for url (http://localhost:8000/originated_multicast_groups)
222026-08-25T09:26:01.079ZINFOslog-rs: restarting MRIB sync loop in one second
232026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bestpath/config/fanout unit = api_server versions = all ending with 2.0.0
242026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bestpath/config/fanout unit = api_server versions = all ending with 2.0.0
252026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bfd/peers unit = api_server versions = all starting from 12.0.0
262026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bfd/peers unit = api_server versions = from 1.0.0 to 12.0.0
272026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bfd/peers unit = api_server versions = all starting from 12.0.0
282026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bfd/peers unit = api_server versions = from 1.0.0 to 12.0.0
292026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bfd/peers/{addr} unit = api_server versions = all
302026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/clear/neighbor unit = api_server versions = all starting from 4.0.0
312026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/clear/neighbor unit = api_server versions = all ending with 4.0.0
322026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/clear/unnumbered-neighbor unit = api_server versions = all starting from 5.0.0
332026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/checker unit = api_server versions = all
342026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/checker unit = api_server versions = all
352026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/checker unit = api_server versions = all
362026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/checker unit = api_server versions = all
372026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/neighbor unit = api_server versions = all ending with 5.0.0
382026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbor unit = api_server versions = from 4.0.0 to 5.0.0
392026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbor unit = api_server versions = all ending with 4.0.0
402026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/neighbor unit = api_server versions = all starting from 11.0.0
412026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/neighbor unit = api_server versions = from 8.0.0 to 11.0.0
422026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/neighbor unit = api_server versions = from 4.0.0 to 8.0.0
432026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/neighbor unit = api_server versions = all ending with 4.0.0
442026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/neighbor unit = api_server versions = all starting from 11.0.0
452026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/neighbor unit = api_server versions = from 8.0.0 to 11.0.0
462026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/neighbor unit = api_server versions = from 4.0.0 to 8.0.0
472026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/neighbor unit = api_server versions = all ending with 4.0.0
482026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/neighbor/{asn}/{peer} unit = api_server versions = all starting from 5.0.0
492026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbor/{asn}/{peer} unit = api_server versions = all starting from 11.0.0
502026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbor/{asn}/{peer} unit = api_server versions = from 8.0.0 to 11.0.0
512026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbor/{asn}/{peer} unit = api_server versions = from 5.0.0 to 8.0.0
522026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbors unit = api_server versions = from 4.0.0 to 5.0.0
532026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbors unit = api_server versions = all ending with 4.0.0
542026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbors/{asn} unit = api_server versions = all starting from 11.0.0
552026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbors/{asn} unit = api_server versions = from 8.0.0 to 11.0.0
562026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbors/{asn} unit = api_server versions = from 5.0.0 to 8.0.0
572026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/origin4 unit = api_server versions = all
582026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/origin4 unit = api_server versions = all starting from 11.0.0
592026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/origin4 unit = api_server versions = all ending with 11.0.0
602026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/origin4 unit = api_server versions = all starting from 11.0.0
612026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/origin4 unit = api_server versions = all ending with 11.0.0
622026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/origin4 unit = api_server versions = all starting from 11.0.0
632026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/origin4 unit = api_server versions = all ending with 11.0.0
642026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/origin6 unit = api_server versions = all starting from 2.0.0
652026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/origin6 unit = api_server versions = all starting from 11.0.0
662026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/origin6 unit = api_server versions = from 2.0.0 to 11.0.0
672026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/origin6 unit = api_server versions = all starting from 11.0.0
682026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/origin6 unit = api_server versions = from 2.0.0 to 11.0.0
692026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/origin6 unit = api_server versions = all starting from 11.0.0
702026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/origin6 unit = api_server versions = from 2.0.0 to 11.0.0
712026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/router unit = api_server versions = all
722026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/router unit = api_server versions = all
732026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/router unit = api_server versions = all
742026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/router unit = api_server versions = all
752026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/routers unit = api_server versions = all
762026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/shaper unit = api_server versions = all
772026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/shaper unit = api_server versions = all
782026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/shaper unit = api_server versions = all
792026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/shaper unit = api_server versions = all
802026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = all starting from 5.0.0
812026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = all starting from 11.0.0
822026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = from 8.0.0 to 11.0.0
832026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = from 5.0.0 to 8.0.0
842026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = all starting from 11.0.0
852026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = from 8.0.0 to 11.0.0
862026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = from 5.0.0 to 8.0.0
872026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = all starting from 11.0.0
882026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = from 8.0.0 to 11.0.0
892026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = from 5.0.0 to 8.0.0
902026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/unnumbered-neighbors unit = api_server versions = all starting from 11.0.0
912026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/unnumbered-neighbors unit = api_server versions = from 8.0.0 to 11.0.0
922026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/unnumbered-neighbors unit = api_server versions = from 5.0.0 to 8.0.0
932026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/history/fsm unit = api_server versions = all starting from 5.0.0
942026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/history/fsm unit = api_server versions = from 2.0.0 to 5.0.0
952026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/history/message unit = api_server versions = all starting from 11.0.0
962026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/history/message unit = api_server versions = from 5.0.0 to 11.0.0
972026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/history/message unit = api_server versions = from 4.0.0 to 5.0.0
982026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/history/message unit = api_server versions = from 2.0.0 to 4.0.0
992026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/message-history unit = api_server versions = all ending with 2.0.0
1002026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/omicron/apply unit = api_server versions = all starting from 11.0.0
1012026-08-25T09:26:01.081ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/omicron/apply unit = api_server versions = from 8.0.0 to 11.0.0
1022026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/omicron/apply unit = api_server versions = from 4.0.0 to 8.0.0
1032026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/omicron/apply unit = api_server versions = all ending with 4.0.0
1042026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/exported unit = api_server versions = all starting from 11.0.0
1052026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/exported unit = api_server versions = from 6.0.0 to 11.0.0
1062026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/exported unit = api_server versions = from 5.0.0 to 6.0.0
1072026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/exported unit = api_server versions = all ending with 5.0.0
1082026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/imported unit = api_server versions = all ending with 2.0.0
1092026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/neighbors unit = api_server versions = all starting from 11.0.0
1102026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/neighbors unit = api_server versions = from 5.0.0 to 11.0.0
1112026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/neighbors unit = api_server versions = from 4.0.0 to 5.0.0
1122026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/neighbors unit = api_server versions = from 2.0.0 to 4.0.0
1132026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/neighbors unit = api_server versions = all ending with 2.0.0
1142026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/selected unit = api_server versions = all ending with 2.0.0
1152026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /mrib/status/imported unit = api_server versions = all starting from 13.0.0
1162026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /mrib/status/selected unit = api_server versions = all starting from 13.0.0
1172026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /ndp/interface unit = api_server versions = all starting from 5.0.0
1182026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /ndp/interfaces unit = api_server versions = all starting from 5.0.0
1192026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /ndp/manager unit = api_server versions = all starting from 5.0.0
1202026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /rib/config/bestpath/fanout unit = api_server versions = all starting from 2.0.0
1212026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /rib/config/bestpath/fanout unit = api_server versions = all starting from 2.0.0
1222026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /rib/status/imported unit = api_server versions = all starting from 5.0.0
1232026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /rib/status/imported unit = api_server versions = from 2.0.0 to 5.0.0
1242026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /rib/status/selected unit = api_server versions = all starting from 5.0.0
1252026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /rib/status/selected unit = api_server versions = from 2.0.0 to 5.0.0
1262026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /static/mroute unit = api_server versions = all starting from 13.0.0
1272026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /static/mroute unit = api_server versions = all starting from 13.0.0
1282026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /static/mroute unit = api_server versions = all starting from 13.0.0
1292026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /static/route4 unit = api_server versions = all starting from 11.0.0
1302026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /static/route4 unit = api_server versions = from 10.0.0 to 11.0.0
1312026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /static/route4 unit = api_server versions = all ending with 10.0.0
1322026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /static/route4 unit = api_server versions = all starting from 5.0.0
1332026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /static/route4 unit = api_server versions = all ending with 5.0.0
1342026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /static/route4 unit = api_server versions = all starting from 11.0.0
1352026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /static/route4 unit = api_server versions = from 10.0.0 to 11.0.0
1362026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /static/route4 unit = api_server versions = all ending with 10.0.0
1372026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /static/route6 unit = api_server versions = all starting from 11.0.0
1382026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /static/route6 unit = api_server versions = from 2.0.0 to 11.0.0
1392026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /static/route6 unit = api_server versions = all starting from 5.0.0
1402026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /static/route6 unit = api_server versions = from 2.0.0 to 5.0.0
1412026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /static/route6 unit = api_server versions = all starting from 11.0.0
1422026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /static/route6 unit = api_server versions = from 2.0.0 to 11.0.0
1432026-08-25T09:26:01.082ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /switch/identifiers unit = api_server versions = all starting from 3.0.0
1442026-08-25T09:26:01.082ZINFOslog-rs (mgd): listening local_addr = [::]:4676 module = admin unit = api_server
1452026-08-25T09:26:01.082ZDEBGslog-rs (mgd): successfully registered DTrace USDT probes local_addr = [::]:4676 module = admin unit = api_server
1462026-08-25T09:26:01.082ZINFOslog-rs: listening on [::]:4676
1472026-08-25T09:26:02.080ZWARNslog-rs (mg-lower): failed to ensure TEP address fd9a:306e:6720:3c93::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd9a:306e:6720:3c93::1 unit = dpd
1482026-08-25T09:26:03.080ZWARNslog-rs (mg-lower): failed to ensure TEP address fd9a:306e:6720:3c93::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd9a:306e:6720:3c93::1 unit = dpd
1492026-08-25T09:26:04.080ZWARNslog-rs (mg-lower): failed to ensure TEP address fd9a:306e:6720:3c93::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd9a:306e:6720:3c93::1 unit = dpd
1502026-08-25T09:26:05.081ZWARNslog-rs (mg-lower): failed to ensure TEP address fd9a:306e:6720:3c93::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd9a:306e:6720:3c93::1 unit = dpd
1512026-08-25T09:26:06.087ZWARNslog-rs (mg-lower): failed to ensure TEP address fd9a:306e:6720:3c93::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd9a:306e:6720:3c93::1 unit = dpd
1522026-08-25T09:26:07.085ZWARNslog-rs (mg-lower): failed to ensure TEP address fd9a:306e:6720:3c93::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd9a:306e:6720:3c93::1 unit = dpd
1532026-08-25T09:26:08.085ZWARNslog-rs (mg-lower): failed to ensure TEP address fd9a:306e:6720:3c93::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd9a:306e:6720:3c93::1 unit = dpd
1542026-08-25T09:26:09.086ZWARNslog-rs (mg-lower): failed to ensure TEP address fd9a:306e:6720:3c93::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd9a:306e:6720:3c93::1 unit = dpd
1552026-08-25T09:26:10.086ZWARNslog-rs (mg-lower): failed to ensure TEP address fd9a:306e:6720:3c93::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd9a:306e:6720:3c93::1 unit = dpd
1562026-08-25T09:26:11.079ZDEBGslog-rs: client request body = None method = GET unit = gateway-client uri = http://[::1]:12225/local/switch-id
1572026-08-25T09:26:11.079ZDEBGslog-rs: client response result = Err(reqwest::Error { kind: Request, url: "http://[::1]:12225/local/switch-id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:12225, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) }) unit = gateway-client
1582026-08-25T09:26:11.079ZERROslog-rs: failed to resolve switch slot error = Communication Error: error sending request for url (http://[::1]:12225/local/switch-id)
1592026-08-25T09:26:11.087ZWARNslog-rs (mg-lower): failed to ensure TEP address fd9a:306e:6720:3c93::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd9a:306e:6720:3c93::1 unit = dpd
160 [ Aug 25 09:26:12 Rereading configuration. ]
161 [ Aug 25 09:26:12 Executing refresh method ("/opt/oxide/mgd/pkg/refresh_ctrun_child.sh -c 211"). ]
162 + CONTRACT=''
163 + getopts c: o
164 + CONTRACT=211
165 + getopts c: o
166 + [[ -n 211 ]]
167 + pgrep -c 211
168 + PARENT_PID=2287
169 + [[ -n 2287 ]]
170 + pgrep -P 2287
171 + CHILD_PID=2288
172 + [[ -n 2288 ]]
173 + kill -USR1 2288
1742026-08-25T09:26:12.456ZINFOslog-rs (mgd): handling smf refresh module = admin unit = smf
175 [ Aug 25 09:26:12 Method "refresh" exited with status 0. ]
1762026-08-25T09:26:12.459ZINFOslog-rs (mgd): starting stats server on smf refresh module = admin unit = smf
1772026-08-25T09:26:12.460ZINFOslog-rs (mgd): started stats server on smf refresh module = admin unit = smf
178 Aug 25 09:26:12.460 DEBG registered DTrace probes
179 Aug 25 09:26:12.461 DEBG registered endpoint, versions: all, path: /{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot
180 Aug 25 09:26:12.461 INFO listening, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:335
181 Aug 25 09:26:12.461 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot
182 Aug 25 09:26:12.461 DEBG Nexus IP not provided, will use DNS to resolve it
183 Aug 25 09:26:12.461 INFO new DNS resolver, addresses: [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53], component: internal-dns-resolver, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/internal-dns/resolver/src/resolver.rs:144
184 Aug 25 09:26:12.461 DEBG starting producer registration task
185 Aug 25 09:26:12.461 INFO starting oximeter metric producer server, interval: 1s, address: [fd00:1122:3344:101::2]:4677, producer_id: 4e92fb85-e223-42fb-9925-372169aebd0f, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:280
186 Aug 25 09:26:12.462 DEBG registering as oximeter producer with Nexus, registration_count: 0, component: producer-registration-task
1872026-08-25T09:26:13.653ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:56042 unit = api_server
1882026-08-25T09:26:13.654ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56042 req_id = 9be0e6c8-133c-4a4e-b2cd-bcf37e60823e unit = api_server uri = /static/route4 version = 13.0.0
1892026-08-25T09:26:13.654ZINFOslog-rs (mgd): request completed latency_us = 322 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56042 req_id = 9be0e6c8-133c-4a4e-b2cd-bcf37e60823e response_code = 200 unit = api_server uri = /static/route4
1902026-08-25T09:26:13.654ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56042 req_id = 3a454f13-3bb5-4d80-87eb-0048050b7fb5 unit = api_server uri = /static/route6 version = 13.0.0
1912026-08-25T09:26:13.654ZINFOslog-rs (mgd): request completed latency_us = 36 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56042 req_id = 3a454f13-3bb5-4d80-87eb-0048050b7fb5 response_code = 200 unit = api_server uri = /static/route6
1922026-08-25T09:26:13.654ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = PUT module = admin remote_addr = [fd00:1122:3344:101::1]:56042 req_id = aece6b5c-8a88-4da9-b44b-2f45baf6b8f8 unit = api_server uri = /static/route4 version = 13.0.0
1932026-08-25T09:26:13.655ZINFOslog-rs (mgd): request completed latency_us = 605 local_addr = [::]:4676 method = PUT module = admin remote_addr = [fd00:1122:3344:101::1]:56042 req_id = aece6b5c-8a88-4da9-b44b-2f45baf6b8f8 response_code = 204 unit = api_server uri = /static/route4
1942026-08-25T09:26:13.655ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56042 req_id = 59ff0de9-ba30-4887-9042-84cdbefa022e unit = api_server uri = /bgp/config/routers version = 13.0.0
1952026-08-25T09:26:13.655ZINFOslog-rs (mgd): request completed latency_us = 69 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56042 req_id = 59ff0de9-ba30-4887-9042-84cdbefa022e response_code = 200 unit = api_server uri = /bgp/config/routers
1962026-08-25T09:26:13.656ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56042 req_id = e4d0b891-f8e3-44cf-b871-0d662eaf21a9 unit = api_server uri = /bfd/peers version = 13.0.0
1972026-08-25T09:26:13.656ZINFOslog-rs (mgd): request completed latency_us = 68 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56042 req_id = e4d0b891-f8e3-44cf-b871-0d662eaf21a9 response_code = 200 unit = api_server uri = /bfd/peers
1982026-08-25T09:26:13.656ZERROslog-rs (mg-lower): handling change failed: route lookup error io error No such process (os error 3) error = route lookup error io error No such process (os error 3) module = sync unit = event_loop
1992026-08-25T09:26:13.656ZINFOslog-rs (mg-lower): restarting sync loop module = sync unit = event_loop
200 Aug 25 09:26:17.465 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("8eaca247-8fb9-4759-acd4-f15a549f2991.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bb191099-ebdd-4b45-8c08-f1e2153936fe.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d2bc0506-35d7-4fbf-857b-4f3f01b8596d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d2bc0506-35d7-4fbf-857b-4f3f01b8596d.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 2324, tv_nsec: 343996937 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
201 Aug 25 09:26:17.465 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
202 Aug 25 09:26:17.466 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
2032026-08-25T09:26:21.081ZDEBGslog-rs: client request body = None method = GET unit = gateway-client uri = http://[::1]:12225/local/switch-id
2042026-08-25T09:26:21.082ZDEBGslog-rs: client response result = Ok(Response { url: "http://[::1]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b3e8554-7077-4977-8cf3-593959ac0382", "content-length": "26", "date": "Tue, 25 Aug 2026 09:26:21 GMT"} }) unit = gateway-client
2052026-08-25T09:26:21.082ZINFOslog-rs: we are in switch slot 0
206 Aug 25 09:26:31.811 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
207 Aug 25 09:26:31.811 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 20.006385031s, count: 0, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
208 Aug 25 09:26:31.997 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("8eaca247-8fb9-4759-acd4-f15a549f2991.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bb191099-ebdd-4b45-8c08-f1e2153936fe.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d2bc0506-35d7-4fbf-857b-4f3f01b8596d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d2bc0506-35d7-4fbf-857b-4f3f01b8596d.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 2339, tv_nsec: 534492050 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
209 Aug 25 09:26:31.998 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
210 Aug 25 09:26:31.999 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
2112026-08-25T09:26:42.970ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:59810 unit = api_server
2122026-08-25T09:26:42.970ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59810 req_id = c8fc3288-14ac-4fec-9a89-8c95ce2a61fc unit = api_server uri = /static/route4 version = 13.0.0
2132026-08-25T09:26:42.970ZINFOslog-rs (mgd): request completed latency_us = 181 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59810 req_id = c8fc3288-14ac-4fec-9a89-8c95ce2a61fc response_code = 200 unit = api_server uri = /static/route4
2142026-08-25T09:26:42.970ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59810 req_id = 3b924f2d-9a64-427a-8cda-ca5bcba8db0d unit = api_server uri = /static/route6 version = 13.0.0
2152026-08-25T09:26:42.970ZINFOslog-rs (mgd): request completed latency_us = 95 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59810 req_id = 3b924f2d-9a64-427a-8cda-ca5bcba8db0d response_code = 200 unit = api_server uri = /static/route6
2162026-08-25T09:26:42.971ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59810 req_id = a31afcfc-de46-46b7-95db-1e40f13b10cc unit = api_server uri = /bgp/config/routers version = 13.0.0
2172026-08-25T09:26:42.971ZINFOslog-rs (mgd): request completed latency_us = 77 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59810 req_id = a31afcfc-de46-46b7-95db-1e40f13b10cc response_code = 200 unit = api_server uri = /bgp/config/routers
2182026-08-25T09:26:42.971ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59810 req_id = 30a3a871-e609-48d1-a62f-5ba74e0c5c4a unit = api_server uri = /bfd/peers version = 13.0.0
2192026-08-25T09:26:42.971ZINFOslog-rs (mgd): request completed latency_us = 30 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59810 req_id = 30a3a871-e609-48d1-a62f-5ba74e0c5c4a response_code = 200 unit = api_server uri = /bfd/peers
220 Aug 25 09:26:46.959 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
221 Aug 25 09:26:46.959 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 35.195611236s, count: 1, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
222 Aug 25 09:26:47.393 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("8eaca247-8fb9-4759-acd4-f15a549f2991.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bb191099-ebdd-4b45-8c08-f1e2153936fe.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d2bc0506-35d7-4fbf-857b-4f3f01b8596d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d2bc0506-35d7-4fbf-857b-4f3f01b8596d.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 2354, tv_nsec: 971493760 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
223 Aug 25 09:26:47.394 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
224 Aug 25 09:26:47.394 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
225 Aug 25 09:27:02.355 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
226 Aug 25 09:27:02.355 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 50.633394128s, count: 2, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
227 Aug 25 09:27:02.920 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("8eaca247-8fb9-4759-acd4-f15a549f2991.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bb191099-ebdd-4b45-8c08-f1e2153936fe.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d2bc0506-35d7-4fbf-857b-4f3f01b8596d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d2bc0506-35d7-4fbf-857b-4f3f01b8596d.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 2370, tv_nsec: 540897382 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
228 Aug 25 09:27:02.921 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
229 Aug 25 09:27:02.922 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
2302026-08-25T09:27:12.891ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:60272 unit = api_server
2312026-08-25T09:27:12.892ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:60272 req_id = 06fe63c8-b5b9-4e39-bdcf-d3c3e6bba345 unit = api_server uri = /static/route4 version = 13.0.0
2322026-08-25T09:27:12.892ZINFOslog-rs (mgd): request completed latency_us = 112 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:60272 req_id = 06fe63c8-b5b9-4e39-bdcf-d3c3e6bba345 response_code = 200 unit = api_server uri = /static/route4
2332026-08-25T09:27:12.892ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:60272 req_id = 0931dc89-9bee-4d7f-9be9-c42ef7e2067b unit = api_server uri = /static/route6 version = 13.0.0
2342026-08-25T09:27:12.892ZINFOslog-rs (mgd): request completed latency_us = 75 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:60272 req_id = 0931dc89-9bee-4d7f-9be9-c42ef7e2067b response_code = 200 unit = api_server uri = /static/route6
2352026-08-25T09:27:12.892ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:60272 req_id = b514219a-a50c-4c25-85d5-d7ed5d808a81 unit = api_server uri = /bgp/config/routers version = 13.0.0
2362026-08-25T09:27:12.892ZINFOslog-rs (mgd): request completed latency_us = 41 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:60272 req_id = b514219a-a50c-4c25-85d5-d7ed5d808a81 response_code = 200 unit = api_server uri = /bgp/config/routers
2372026-08-25T09:27:12.893ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:60272 req_id = ccac9c1e-1532-4c72-912e-534f03c1444c unit = api_server uri = /bfd/peers version = 13.0.0
2382026-08-25T09:27:12.893ZINFOslog-rs (mgd): request completed latency_us = 53 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:60272 req_id = ccac9c1e-1532-4c72-912e-534f03c1444c response_code = 200 unit = api_server uri = /bfd/peers
239 Aug 25 09:27:17.883 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
240 Aug 25 09:27:17.883 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 66.203511992s, count: 3, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
241 Aug 25 09:27:18.975 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("8eaca247-8fb9-4759-acd4-f15a549f2991.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bb191099-ebdd-4b45-8c08-f1e2153936fe.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d2bc0506-35d7-4fbf-857b-4f3f01b8596d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d2bc0506-35d7-4fbf-857b-4f3f01b8596d.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 2386, tv_nsec: 639311392 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
242 Aug 25 09:27:18.976 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
243 Aug 25 09:27:18.977 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
244 Aug 25 09:27:33.948 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
245 Aug 25 09:27:33.948 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 82.301372802s, count: 4, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
246 Aug 25 09:27:38.913 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("8eaca247-8fb9-4759-acd4-f15a549f2991.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bb191099-ebdd-4b45-8c08-f1e2153936fe.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d2bc0506-35d7-4fbf-857b-4f3f01b8596d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d2bc0506-35d7-4fbf-857b-4f3f01b8596d.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 2406, tv_nsec: 606886650 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
247 Aug 25 09:27:38.944 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
248 Aug 25 09:27:38.945 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
2492026-08-25T09:27:42.848ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:58119 unit = api_server
2502026-08-25T09:27:42.848ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:58119 req_id = 89e866ff-77a2-4713-b4a4-13e37a10a440 unit = api_server uri = /static/route4 version = 13.0.0
2512026-08-25T09:27:42.848ZINFOslog-rs (mgd): request completed latency_us = 75 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:58119 req_id = 89e866ff-77a2-4713-b4a4-13e37a10a440 response_code = 200 unit = api_server uri = /static/route4
2522026-08-25T09:27:42.848ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:58119 req_id = 2d37dd4e-fe29-40cd-b862-03e0593ea056 unit = api_server uri = /static/route6 version = 13.0.0
2532026-08-25T09:27:42.848ZINFOslog-rs (mgd): request completed latency_us = 84 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:58119 req_id = 2d37dd4e-fe29-40cd-b862-03e0593ea056 response_code = 200 unit = api_server uri = /static/route6
2542026-08-25T09:27:42.848ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:58119 req_id = ebe2d11c-fba6-4a1a-84a9-aca051b996c1 unit = api_server uri = /bgp/config/routers version = 13.0.0
2552026-08-25T09:27:42.849ZINFOslog-rs (mgd): request completed latency_us = 52 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:58119 req_id = ebe2d11c-fba6-4a1a-84a9-aca051b996c1 response_code = 200 unit = api_server uri = /bgp/config/routers
2562026-08-25T09:27:42.849ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:58119 req_id = f52a416e-dee9-4a28-9c42-5bad43d66a99 unit = api_server uri = /bfd/peers version = 13.0.0
2572026-08-25T09:27:42.849ZINFOslog-rs (mgd): request completed latency_us = 42 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:58119 req_id = f52a416e-dee9-4a28-9c42-5bad43d66a99 response_code = 200 unit = api_server uri = /bfd/peers
258 Aug 25 09:27:53.946 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
259 Aug 25 09:27:53.946 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 102.298646476s, count: 5, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
260 Aug 25 09:27:58.886 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("8eaca247-8fb9-4759-acd4-f15a549f2991.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bb191099-ebdd-4b45-8c08-f1e2153936fe.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d2bc0506-35d7-4fbf-857b-4f3f01b8596d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d2bc0506-35d7-4fbf-857b-4f3f01b8596d.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 2426, tv_nsec: 580353865 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
261 Aug 25 09:27:58.887 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
262 Aug 25 09:27:58.888 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
2632026-08-25T09:28:12.851ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:49647 unit = api_server
2642026-08-25T09:28:12.851ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:49647 req_id = adbbaad1-2271-4215-aa37-48445d848734 unit = api_server uri = /static/route4 version = 13.0.0
2652026-08-25T09:28:12.851ZINFOslog-rs (mgd): request completed latency_us = 102 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:49647 req_id = adbbaad1-2271-4215-aa37-48445d848734 response_code = 200 unit = api_server uri = /static/route4
2662026-08-25T09:28:12.851ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:49647 req_id = 8a69a050-0d2c-4a93-ac6d-d40527365509 unit = api_server uri = /static/route6 version = 13.0.0
2672026-08-25T09:28:12.851ZINFOslog-rs (mgd): request completed latency_us = 54 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:49647 req_id = 8a69a050-0d2c-4a93-ac6d-d40527365509 response_code = 200 unit = api_server uri = /static/route6
2682026-08-25T09:28:12.851ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:49647 req_id = cdae2d42-7a78-45eb-8be6-0473b71c39d2 unit = api_server uri = /bgp/config/routers version = 13.0.0
2692026-08-25T09:28:12.851ZINFOslog-rs (mgd): request completed latency_us = 35 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:49647 req_id = cdae2d42-7a78-45eb-8be6-0473b71c39d2 response_code = 200 unit = api_server uri = /bgp/config/routers
2702026-08-25T09:28:12.851ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:49647 req_id = dfc1700c-e57d-4f98-b200-10b341a14258 unit = api_server uri = /bfd/peers version = 13.0.0
2712026-08-25T09:28:12.851ZINFOslog-rs (mgd): request completed latency_us = 23 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:49647 req_id = dfc1700c-e57d-4f98-b200-10b341a14258 response_code = 200 unit = api_server uri = /bfd/peers
272 Aug 25 09:28:13.890 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
273 Aug 25 09:28:13.890 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 122.242163322s, count: 6, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
274 Aug 25 09:28:34.550 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("8eaca247-8fb9-4759-acd4-f15a549f2991.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bb191099-ebdd-4b45-8c08-f1e2153936fe.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d2bc0506-35d7-4fbf-857b-4f3f01b8596d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d2bc0506-35d7-4fbf-857b-4f3f01b8596d.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 2462, tv_nsec: 243700107 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
275 Aug 25 09:28:34.551 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
276 Aug 25 09:28:34.552 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
2772026-08-25T09:28:42.854ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:54252 unit = api_server
2782026-08-25T09:28:42.854ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:54252 req_id = 584aa9e6-b361-48f2-bac9-abfcfdf64e3c unit = api_server uri = /static/route4 version = 13.0.0
2792026-08-25T09:28:42.854ZINFOslog-rs (mgd): request completed latency_us = 81 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:54252 req_id = 584aa9e6-b361-48f2-bac9-abfcfdf64e3c response_code = 200 unit = api_server uri = /static/route4
2802026-08-25T09:28:42.886ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:54252 req_id = 13271dc9-7d10-4b1d-ada6-1de6115d4e2f unit = api_server uri = /static/route6 version = 13.0.0
2812026-08-25T09:28:42.887ZINFOslog-rs (mgd): request completed latency_us = 149 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:54252 req_id = 13271dc9-7d10-4b1d-ada6-1de6115d4e2f response_code = 200 unit = api_server uri = /static/route6
2822026-08-25T09:28:42.898ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:54252 req_id = 943e103b-d118-49ff-881e-743b6b2db787 unit = api_server uri = /bgp/config/routers version = 13.0.0
2832026-08-25T09:28:42.898ZINFOslog-rs (mgd): request completed latency_us = 54 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:54252 req_id = 943e103b-d118-49ff-881e-743b6b2db787 response_code = 200 unit = api_server uri = /bgp/config/routers
2842026-08-25T09:28:42.898ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:54252 req_id = f41c99f9-637f-4747-83fd-a7981c2a03fd unit = api_server uri = /bfd/peers version = 13.0.0
2852026-08-25T09:28:42.898ZINFOslog-rs (mgd): request completed latency_us = 68 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:54252 req_id = f41c99f9-637f-4747-83fd-a7981c2a03fd response_code = 200 unit = api_server uri = /bfd/peers
286 Aug 25 09:28:49.572 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
287 Aug 25 09:28:49.581 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 157.927119429s, count: 7, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
2882026-08-25T09:29:12.903ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:51941 unit = api_server
2892026-08-25T09:29:12.925ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:51941 req_id = 10ad8e42-3250-4bc2-b397-4b590dddd3be unit = api_server uri = /static/route4 version = 13.0.0
2902026-08-25T09:29:12.931ZINFOslog-rs (mgd): request completed latency_us = 29080 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:51941 req_id = 10ad8e42-3250-4bc2-b397-4b590dddd3be response_code = 200 unit = api_server uri = /static/route4
2912026-08-25T09:29:12.932ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:51941 req_id = ebaa5c52-f2eb-4312-b807-c2fdc390a5b3 unit = api_server uri = /static/route6 version = 13.0.0
2922026-08-25T09:29:12.932ZINFOslog-rs (mgd): request completed latency_us = 221 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:51941 req_id = ebaa5c52-f2eb-4312-b807-c2fdc390a5b3 response_code = 200 unit = api_server uri = /static/route6
2932026-08-25T09:29:12.932ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:51941 req_id = 3bf4d5c2-6e38-4c15-8b87-cb62c03cd4ac unit = api_server uri = /bgp/config/routers version = 13.0.0
2942026-08-25T09:29:12.955ZINFOslog-rs (mgd): request completed latency_us = 22976 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:51941 req_id = 3bf4d5c2-6e38-4c15-8b87-cb62c03cd4ac response_code = 200 unit = api_server uri = /bgp/config/routers
2952026-08-25T09:29:12.956ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:51941 req_id = 3a7592de-9028-4fbc-938a-9cbbcff86830 unit = api_server uri = /bfd/peers version = 13.0.0
2962026-08-25T09:29:12.956ZINFOslog-rs (mgd): request completed latency_us = 642 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:51941 req_id = 3a7592de-9028-4fbc-938a-9cbbcff86830 response_code = 200 unit = api_server uri = /bfd/peers
297 Aug 25 09:29:21.898 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("8eaca247-8fb9-4759-acd4-f15a549f2991.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("bb191099-ebdd-4b45-8c08-f1e2153936fe.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d2bc0506-35d7-4fbf-857b-4f3f01b8596d.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d2bc0506-35d7-4fbf-857b-4f3f01b8596d.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 2509, tv_nsec: 590424996 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
298 Aug 25 09:29:21.899 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
299 Aug 25 09:29:21.915 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
300 Aug 25 09:29:26.756 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::c]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) }), component: producer-registration-task
301 Aug 25 09:29:26.756 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): client error (Connect): tcp connect error: Connection refused (os error 146), delay: 195.107674925s, count: 8, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
3022026-08-25T09:29:37.789ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::b]:39124 unit = api_server
3032026-08-25T09:29:37.789ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:39124 req_id = 77e0f0c0-f3de-46d8-b063-b497b09aca4f unit = api_server uri = /static/mroute version = 13.0.0
3042026-08-25T09:29:37.790ZINFOslog-rs (mgd): request completed latency_us = 1363 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:39124 req_id = 77e0f0c0-f3de-46d8-b063-b497b09aca4f response_code = 200 unit = api_server uri = /static/mroute
3052026-08-25T09:29:39.047ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::c]:34385 unit = api_server
3062026-08-25T09:29:39.048ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:34385 req_id = d70a73a2-d155-42bd-8312-153b5fe4cfdc unit = api_server uri = /static/mroute version = 13.0.0
3072026-08-25T09:29:39.048ZINFOslog-rs (mgd): request completed latency_us = 98 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:34385 req_id = d70a73a2-d155-42bd-8312-153b5fe4cfdc response_code = 200 unit = api_server uri = /static/mroute
3082026-08-25T09:29:39.059ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::a]:46886 unit = api_server
3092026-08-25T09:29:39.059ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:46886 req_id = 967782bc-0f41-40cc-90a5-320a4ec76a21 unit = api_server uri = /static/mroute version = 13.0.0
3102026-08-25T09:29:39.060ZINFOslog-rs (mgd): request completed latency_us = 74 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:46886 req_id = 967782bc-0f41-40cc-90a5-320a4ec76a21 response_code = 200 unit = api_server uri = /static/mroute
3112026-08-25T09:29:41.344ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::a]:46796 unit = api_server
3122026-08-25T09:29:41.344ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:46796 req_id = 056cc0bb-919e-49db-a2c5-5bbc5e6c73cd unit = api_server uri = /static/mroute version = 13.0.0
3132026-08-25T09:29:41.344ZINFOslog-rs (mgd): request completed latency_us = 64 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:46796 req_id = 056cc0bb-919e-49db-a2c5-5bbc5e6c73cd response_code = 200 unit = api_server uri = /static/mroute
3142026-08-25T09:29:42.184ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::c]:51470 unit = api_server
3152026-08-25T09:29:42.184ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:51470 req_id = 3e4fa14a-d6e6-47c6-a3cd-9d54a05aec07 unit = api_server uri = /static/mroute version = 13.0.0
3162026-08-25T09:29:42.184ZINFOslog-rs (mgd): request completed latency_us = 70 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:51470 req_id = 3e4fa14a-d6e6-47c6-a3cd-9d54a05aec07 response_code = 200 unit = api_server uri = /static/mroute
3172026-08-25T09:29:42.437ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::b]:38497 unit = api_server
3182026-08-25T09:29:42.437ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:38497 req_id = d5904a06-2156-467c-b931-0f75fb3df0eb unit = api_server uri = /static/mroute version = 13.0.0
3192026-08-25T09:29:42.437ZINFOslog-rs (mgd): request completed latency_us = 73 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:38497 req_id = d5904a06-2156-467c-b931-0f75fb3df0eb response_code = 200 unit = api_server uri = /static/mroute
3202026-08-25T09:29:42.652ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::c]:38971 unit = api_server
3212026-08-25T09:29:42.652ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:38971 req_id = 2e546c12-b1e3-4ef0-a9a9-e1ede46ca7b3 unit = api_server uri = /static/mroute version = 13.0.0
3222026-08-25T09:29:42.652ZINFOslog-rs (mgd): request completed latency_us = 56 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:38971 req_id = 2e546c12-b1e3-4ef0-a9a9-e1ede46ca7b3 response_code = 200 unit = api_server uri = /static/mroute
3232026-08-25T09:29:42.958ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:35030 unit = api_server
3242026-08-25T09:29:42.958ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:35030 req_id = 56a0fc76-0bf4-4a13-94f6-32838fa4b2ed unit = api_server uri = /static/route4 version = 13.0.0
3252026-08-25T09:29:42.959ZINFOslog-rs (mgd): request completed latency_us = 85 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:35030 req_id = 56a0fc76-0bf4-4a13-94f6-32838fa4b2ed response_code = 200 unit = api_server uri = /static/route4
3262026-08-25T09:29:42.959ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:35030 req_id = cbc0da9f-a3e2-4449-bb23-accede7e0fda unit = api_server uri = /static/route6 version = 13.0.0
3272026-08-25T09:29:42.959ZINFOslog-rs (mgd): request completed latency_us = 67 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:35030 req_id = cbc0da9f-a3e2-4449-bb23-accede7e0fda response_code = 200 unit = api_server uri = /static/route6
3282026-08-25T09:29:42.959ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:35030 req_id = 38afce64-3599-4241-9e71-0bb853005570 unit = api_server uri = /bgp/config/routers version = 13.0.0
3292026-08-25T09:29:42.959ZINFOslog-rs (mgd): request completed latency_us = 36 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:35030 req_id = 38afce64-3599-4241-9e71-0bb853005570 response_code = 200 unit = api_server uri = /bgp/config/routers
3302026-08-25T09:29:42.959ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:35030 req_id = 7c485a4b-a2d3-4aca-98a3-4dea08b72c0f unit = api_server uri = /bfd/peers version = 13.0.0
3312026-08-25T09:29:42.959ZINFOslog-rs (mgd): request completed latency_us = 23 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:35030 req_id = 7c485a4b-a2d3-4aca-98a3-4dea08b72c0f response_code = 200 unit = api_server uri = /bfd/peers
3322026-08-25T09:29:43.919ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::c]:45498 unit = api_server
3332026-08-25T09:29:43.919ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:45498 req_id = 92ff8af8-ac72-44d2-a748-bea9a5a0c598 unit = api_server uri = /static/mroute version = 13.0.0
3342026-08-25T09:29:43.919ZINFOslog-rs (mgd): request completed latency_us = 62 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:45498 req_id = 92ff8af8-ac72-44d2-a748-bea9a5a0c598 response_code = 200 unit = api_server uri = /static/mroute
3352026-08-25T09:29:44.091ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::c]:37241 unit = api_server
3362026-08-25T09:29:44.091ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:37241 req_id = 8a52a074-13ed-4a6a-9052-9c6af402a166 unit = api_server uri = /static/mroute version = 13.0.0
3372026-08-25T09:29:44.091ZINFOslog-rs (mgd): request completed latency_us = 48 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:37241 req_id = 8a52a074-13ed-4a6a-9052-9c6af402a166 response_code = 200 unit = api_server uri = /static/mroute
3382026-08-25T09:29:48.711ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::b]:58967 unit = api_server
3392026-08-25T09:29:48.711ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:58967 req_id = 6ffad2bc-3df3-4996-8ca6-0723abd24dd7 unit = api_server uri = /static/mroute version = 13.0.0
3402026-08-25T09:29:48.711ZINFOslog-rs (mgd): request completed latency_us = 73 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:58967 req_id = 6ffad2bc-3df3-4996-8ca6-0723abd24dd7 response_code = 200 unit = api_server uri = /static/mroute
3412026-08-25T09:29:49.924ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::a]:39988 unit = api_server
3422026-08-25T09:29:49.924ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:39988 req_id = 1142f166-0c12-4533-ae84-af75a6e3bf12 unit = api_server uri = /static/mroute version = 13.0.0
3432026-08-25T09:29:49.925ZINFOslog-rs (mgd): request completed latency_us = 67 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::a]:39988 req_id = 1142f166-0c12-4533-ae84-af75a6e3bf12 response_code = 200 unit = api_server uri = /static/mroute
3442026-08-25T09:29:52.139ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::b]:53522 unit = api_server
3452026-08-25T09:29:52.139ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:53522 req_id = 463e09a7-39e7-47e4-ba33-dfcde695b88e unit = api_server uri = /static/mroute version = 13.0.0
3462026-08-25T09:29:52.139ZINFOslog-rs (mgd): request completed latency_us = 56 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::b]:53522 req_id = 463e09a7-39e7-47e4-ba33-dfcde695b88e response_code = 200 unit = api_server uri = /static/mroute
3472026-08-25T09:29:53.329ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::c]:46000 unit = api_server
3482026-08-25T09:29:53.329ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:46000 req_id = 0567e7a1-20b4-424d-945e-534da5b38f49 unit = api_server uri = /static/mroute version = 13.0.0
3492026-08-25T09:29:53.329ZINFOslog-rs (mgd): request completed latency_us = 81 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::c]:46000 req_id = 0567e7a1-20b4-424d-945e-534da5b38f49 response_code = 200 unit = api_server uri = /static/mroute