Max level shown:
1 [ Aug 22 03:54:34 Disabled. ]
2 [ Aug 22 03:54:34 Rereading configuration. ]
3 [ Aug 22 03:54:35 Enabled. ]
4 [ Aug 22 03:54:35 Rereading configuration. ]
5 [ Aug 22 03:54:35 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/mgd/pkg/mgd_method_script.sh &"). ]
6 [ Aug 22 03:54:35 Method "start" exited with status 0. ]
72026-08-22T03:54:35.280ZINFOslog-rs (mgd): signal handler waiting for context module = admin unit = signal
82026-08-22T03:54:35.303ZINFOslog-rs (mgd): interface monitor started module = unnumbered manager unit = daemon
92026-08-22T03:54:35.303ZINFOslog-rs (bgp): dispatcher started module = neighbor unit = dispatcher
102026-08-22T03:54:35.303ZINFOslog-rs (bgp): starting listener with bind arg: [::]:179 module = neighbor unit = dispatcher
112026-08-22T03:54:35.303ZINFOslog-rs (bgp): TcpListener created listener = TcpListener { addr: [::]:179, fd: 10 } module = neighbor unit = dispatcher
122026-08-22T03:54:35.303ZINFOslog-rs (bgp): transitioning to accept loop bind_addr = [::]:179 module = neighbor unit = dispatcher
132026-08-22T03:54:35.303ZINFOslog-rs (mgd): signal handler got context module = admin unit = signal
142026-08-22T03:54:35.306ZDEBGslog-rs: client request body = None method = GET unit = gateway-client uri = http://[::1]:12225/local/switch-id
152026-08-22T03:54:35.307ZDEBGslog-rs: client response result = Err(reqwest::Error { kind: Request, url: "http://[::1]:12225/local/switch-id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:12225, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) }) unit = gateway-client
162026-08-22T03:54:35.307ZERROslog-rs: failed to resolve switch slot error = Communication Error: error sending request for url (http://[::1]:12225/local/switch-id)
172026-08-22T03:54:35.307ZINFOslog-rs (mgd): starting bgp routers: {} module = admin unit = daemon
182026-08-22T03:54:35.307ZINFOslog-rs (mgd): starting bfd sessions: [] module = admin unit = daemon
192026-08-22T03:54:35.308ZERROslog-rs (mgd): failed to start stats server: underlay address not found error = underlay address not found module = admin params = hostname oxz_switch, rack 25d8f5af-bb8b-4387-abcb-2f64fae6afa7, sled e48c82d1-a9c2-4160-ad2e-41b60117b976 unit = daemon
202026-08-22T03:54:35.308ZWARNslog-rs (mg-lower): failed to ensure TEP address fd35:bae4:331b:5ed3::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd35:bae4:331b:5ed3::1 unit = dpd
212026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bestpath/config/fanout unit = api_server versions = all ending with 2.0.0
222026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bestpath/config/fanout unit = api_server versions = all ending with 2.0.0
232026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bfd/peers unit = api_server versions = all starting from 12.0.0
242026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bfd/peers unit = api_server versions = from 1.0.0 to 12.0.0
252026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bfd/peers unit = api_server versions = all starting from 12.0.0
262026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bfd/peers unit = api_server versions = from 1.0.0 to 12.0.0
272026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bfd/peers/{addr} unit = api_server versions = all
282026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/clear/neighbor unit = api_server versions = all starting from 4.0.0
292026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/clear/neighbor unit = api_server versions = all ending with 4.0.0
302026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/clear/unnumbered-neighbor unit = api_server versions = all starting from 5.0.0
312026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/checker unit = api_server versions = all
322026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/checker unit = api_server versions = all
332026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/checker unit = api_server versions = all
342026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/checker unit = api_server versions = all
352026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/neighbor unit = api_server versions = all ending with 5.0.0
362026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbor unit = api_server versions = from 4.0.0 to 5.0.0
372026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbor unit = api_server versions = all ending with 4.0.0
382026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/neighbor unit = api_server versions = all starting from 11.0.0
392026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/neighbor unit = api_server versions = from 8.0.0 to 11.0.0
402026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/neighbor unit = api_server versions = from 4.0.0 to 8.0.0
412026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/neighbor unit = api_server versions = all ending with 4.0.0
422026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/neighbor unit = api_server versions = all starting from 11.0.0
432026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/neighbor unit = api_server versions = from 8.0.0 to 11.0.0
442026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/neighbor unit = api_server versions = from 4.0.0 to 8.0.0
452026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/neighbor unit = api_server versions = all ending with 4.0.0
462026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/neighbor/{asn}/{peer} unit = api_server versions = all starting from 5.0.0
472026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbor/{asn}/{peer} unit = api_server versions = all starting from 11.0.0
482026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbor/{asn}/{peer} unit = api_server versions = from 8.0.0 to 11.0.0
492026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbor/{asn}/{peer} unit = api_server versions = from 5.0.0 to 8.0.0
502026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbors unit = api_server versions = from 4.0.0 to 5.0.0
512026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbors unit = api_server versions = all ending with 4.0.0
522026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbors/{asn} unit = api_server versions = all starting from 11.0.0
532026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbors/{asn} unit = api_server versions = from 8.0.0 to 11.0.0
542026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbors/{asn} unit = api_server versions = from 5.0.0 to 8.0.0
552026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/origin4 unit = api_server versions = all
562026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/origin4 unit = api_server versions = all starting from 11.0.0
572026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/origin4 unit = api_server versions = all ending with 11.0.0
582026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/origin4 unit = api_server versions = all starting from 11.0.0
592026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/origin4 unit = api_server versions = all ending with 11.0.0
602026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/origin4 unit = api_server versions = all starting from 11.0.0
612026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/origin4 unit = api_server versions = all ending with 11.0.0
622026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/origin6 unit = api_server versions = all starting from 2.0.0
632026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/origin6 unit = api_server versions = all starting from 11.0.0
642026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/origin6 unit = api_server versions = from 2.0.0 to 11.0.0
652026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/origin6 unit = api_server versions = all starting from 11.0.0
662026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/origin6 unit = api_server versions = from 2.0.0 to 11.0.0
672026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/origin6 unit = api_server versions = all starting from 11.0.0
682026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/origin6 unit = api_server versions = from 2.0.0 to 11.0.0
692026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/router unit = api_server versions = all
702026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/router unit = api_server versions = all
712026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/router unit = api_server versions = all
722026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/router unit = api_server versions = all
732026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/routers unit = api_server versions = all
742026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/shaper unit = api_server versions = all
752026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/shaper unit = api_server versions = all
762026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/shaper unit = api_server versions = all
772026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/shaper unit = api_server versions = all
782026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = all starting from 5.0.0
792026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = all starting from 11.0.0
802026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = from 8.0.0 to 11.0.0
812026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = from 5.0.0 to 8.0.0
822026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = all starting from 11.0.0
832026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = from 8.0.0 to 11.0.0
842026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = from 5.0.0 to 8.0.0
852026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = all starting from 11.0.0
862026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = from 8.0.0 to 11.0.0
872026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = from 5.0.0 to 8.0.0
882026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/unnumbered-neighbors unit = api_server versions = all starting from 11.0.0
892026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/unnumbered-neighbors unit = api_server versions = from 8.0.0 to 11.0.0
902026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/unnumbered-neighbors unit = api_server versions = from 5.0.0 to 8.0.0
912026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/history/fsm unit = api_server versions = all starting from 5.0.0
922026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/history/fsm unit = api_server versions = from 2.0.0 to 5.0.0
932026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/history/message unit = api_server versions = all starting from 11.0.0
942026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/history/message unit = api_server versions = from 5.0.0 to 11.0.0
952026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/history/message unit = api_server versions = from 4.0.0 to 5.0.0
962026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/history/message unit = api_server versions = from 2.0.0 to 4.0.0
972026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/message-history unit = api_server versions = all ending with 2.0.0
982026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/omicron/apply unit = api_server versions = all starting from 11.0.0
992026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/omicron/apply unit = api_server versions = from 8.0.0 to 11.0.0
1002026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/omicron/apply unit = api_server versions = from 4.0.0 to 8.0.0
1012026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/omicron/apply unit = api_server versions = all ending with 4.0.0
1022026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/exported unit = api_server versions = all starting from 11.0.0
1032026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/exported unit = api_server versions = from 6.0.0 to 11.0.0
1042026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/exported unit = api_server versions = from 5.0.0 to 6.0.0
1052026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/exported unit = api_server versions = all ending with 5.0.0
1062026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/imported unit = api_server versions = all ending with 2.0.0
1072026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/neighbors unit = api_server versions = all starting from 11.0.0
1082026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/neighbors unit = api_server versions = from 5.0.0 to 11.0.0
1092026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/neighbors unit = api_server versions = from 4.0.0 to 5.0.0
1102026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/neighbors unit = api_server versions = from 2.0.0 to 4.0.0
1112026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/neighbors unit = api_server versions = all ending with 2.0.0
1122026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/selected unit = api_server versions = all ending with 2.0.0
1132026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /ndp/interface unit = api_server versions = all starting from 5.0.0
1142026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /ndp/interfaces unit = api_server versions = all starting from 5.0.0
1152026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /ndp/manager unit = api_server versions = all starting from 5.0.0
1162026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /rib/config/bestpath/fanout unit = api_server versions = all starting from 2.0.0
1172026-08-22T03:54:35.310ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /rib/config/bestpath/fanout unit = api_server versions = all starting from 2.0.0
1182026-08-22T03:54:35.311ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /rib/status/imported unit = api_server versions = all starting from 5.0.0
1192026-08-22T03:54:35.311ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /rib/status/imported unit = api_server versions = from 2.0.0 to 5.0.0
1202026-08-22T03:54:35.311ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /rib/status/selected unit = api_server versions = all starting from 5.0.0
1212026-08-22T03:54:35.311ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /rib/status/selected unit = api_server versions = from 2.0.0 to 5.0.0
1222026-08-22T03:54:35.311ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /static/route4 unit = api_server versions = all starting from 11.0.0
1232026-08-22T03:54:35.311ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /static/route4 unit = api_server versions = from 10.0.0 to 11.0.0
1242026-08-22T03:54:35.311ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /static/route4 unit = api_server versions = all ending with 10.0.0
1252026-08-22T03:54:35.311ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /static/route4 unit = api_server versions = all starting from 5.0.0
1262026-08-22T03:54:35.311ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /static/route4 unit = api_server versions = all ending with 5.0.0
1272026-08-22T03:54:35.311ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /static/route4 unit = api_server versions = all starting from 11.0.0
1282026-08-22T03:54:35.311ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /static/route4 unit = api_server versions = from 10.0.0 to 11.0.0
1292026-08-22T03:54:35.311ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /static/route4 unit = api_server versions = all ending with 10.0.0
1302026-08-22T03:54:35.311ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /static/route6 unit = api_server versions = all starting from 11.0.0
1312026-08-22T03:54:35.311ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /static/route6 unit = api_server versions = from 2.0.0 to 11.0.0
1322026-08-22T03:54:35.311ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /static/route6 unit = api_server versions = all starting from 5.0.0
1332026-08-22T03:54:35.311ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /static/route6 unit = api_server versions = from 2.0.0 to 5.0.0
1342026-08-22T03:54:35.311ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /static/route6 unit = api_server versions = all starting from 11.0.0
1352026-08-22T03:54:35.311ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /static/route6 unit = api_server versions = from 2.0.0 to 11.0.0
1362026-08-22T03:54:35.311ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /switch/identifiers unit = api_server versions = all starting from 3.0.0
1372026-08-22T03:54:35.311ZINFOslog-rs (mgd): listening local_addr = [::]:4676 module = admin unit = api_server
1382026-08-22T03:54:35.311ZDEBGslog-rs (mgd): successfully registered DTrace USDT probes local_addr = [::]:4676 module = admin unit = api_server
1392026-08-22T03:54:35.311ZINFOslog-rs: listening on [::]:4676
1402026-08-22T03:54:36.309ZWARNslog-rs (mg-lower): failed to ensure TEP address fd35:bae4:331b:5ed3::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd35:bae4:331b:5ed3::1 unit = dpd
1412026-08-22T03:54:37.309ZWARNslog-rs (mg-lower): failed to ensure TEP address fd35:bae4:331b:5ed3::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd35:bae4:331b:5ed3::1 unit = dpd
1422026-08-22T03:54:38.310ZWARNslog-rs (mg-lower): failed to ensure TEP address fd35:bae4:331b:5ed3::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd35:bae4:331b:5ed3::1 unit = dpd
1432026-08-22T03:54:39.310ZWARNslog-rs (mg-lower): failed to ensure TEP address fd35:bae4:331b:5ed3::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd35:bae4:331b:5ed3::1 unit = dpd
1442026-08-22T03:54:40.311ZWARNslog-rs (mg-lower): failed to ensure TEP address fd35:bae4:331b:5ed3::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd35:bae4:331b:5ed3::1 unit = dpd
1452026-08-22T03:54:41.311ZWARNslog-rs (mg-lower): failed to ensure TEP address fd35:bae4:331b:5ed3::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd35:bae4:331b:5ed3::1 unit = dpd
1462026-08-22T03:54:42.311ZWARNslog-rs (mg-lower): failed to ensure TEP address fd35:bae4:331b:5ed3::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd35:bae4:331b:5ed3::1 unit = dpd
1472026-08-22T03:54:43.312ZWARNslog-rs (mg-lower): failed to ensure TEP address fd35:bae4:331b:5ed3::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd35:bae4:331b:5ed3::1 unit = dpd
1482026-08-22T03:54:44.312ZWARNslog-rs (mg-lower): failed to ensure TEP address fd35:bae4:331b:5ed3::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd35:bae4:331b:5ed3::1 unit = dpd
1492026-08-22T03:54:45.308ZDEBGslog-rs: client request body = None method = GET unit = gateway-client uri = http://[::1]:12225/local/switch-id
1502026-08-22T03:54:45.308ZDEBGslog-rs: client response result = Err(reqwest::Error { kind: Request, url: "http://[::1]:12225/local/switch-id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:12225, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) }) unit = gateway-client
1512026-08-22T03:54:45.308ZERROslog-rs: failed to resolve switch slot error = Communication Error: error sending request for url (http://[::1]:12225/local/switch-id)
1522026-08-22T03:54:45.313ZWARNslog-rs (mg-lower): failed to ensure TEP address fd35:bae4:331b:5ed3::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd35:bae4:331b:5ed3::1 unit = dpd
1532026-08-22T03:54:46.313ZWARNslog-rs (mg-lower): failed to ensure TEP address fd35:bae4:331b:5ed3::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd35:bae4:331b:5ed3::1 unit = dpd
1542026-08-22T03:54:47.314ZWARNslog-rs (mg-lower): failed to ensure TEP address fd35:bae4:331b:5ed3::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fd35:bae4:331b:5ed3::1 unit = dpd
155 [ Aug 22 03:54:47 Rereading configuration. ]
156 [ Aug 22 03:54:47 Executing refresh method ("/opt/oxide/mgd/pkg/refresh_ctrun_child.sh -c 211"). ]
157 + CONTRACT=''
158 + getopts c: o
159 + CONTRACT=211
160 + getopts c: o
161 + [[ -n 211 ]]
162 + pgrep -c 211
163 + PARENT_PID=2286
164 + [[ -n 2286 ]]
165 + pgrep -P 2286
166 + CHILD_PID=2288
167 + [[ -n 2288 ]]
168 + kill -USR1 2288
1692026-08-22T03:54:47.942ZINFOslog-rs (mgd): handling smf refresh module = admin unit = smf
170 [ Aug 22 03:54:47 Method "refresh" exited with status 0. ]
1712026-08-22T03:54:47.945ZINFOslog-rs (mgd): starting stats server on smf refresh module = admin unit = smf
1722026-08-22T03:54:47.945ZINFOslog-rs (mgd): started stats server on smf refresh module = admin unit = smf
173 Aug 22 03:54:47.945 DEBG registered DTrace probes
174 Aug 22 03:54:47.946 DEBG registered endpoint, versions: all, path: /{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot
175 Aug 22 03:54:47.946 INFO listening, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:335
176 Aug 22 03:54:47.946 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot
177 Aug 22 03:54:47.946 DEBG Nexus IP not provided, will use DNS to resolve it
178 Aug 22 03:54:47.946 INFO new DNS resolver, addresses: [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53], component: internal-dns-resolver, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/internal-dns/resolver/src/resolver.rs:144
179 Aug 22 03:54:47.946 DEBG starting producer registration task
180 Aug 22 03:54:47.946 INFO starting oximeter metric producer server, interval: 1s, address: [fd00:1122:3344:101::2]:4677, producer_id: 2c24c9e5-e1df-4121-bf46-3b3e32b2f4e8, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:280
181 Aug 22 03:54:47.947 DEBG registering as oximeter producer with Nexus, registration_count: 0, component: producer-registration-task
182 Aug 22 03:54:47.948 WARN failed to register with Nexus, will retry, error: proto error: no records found for Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, delay: 1.195282ms, count: 0, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
183 Aug 22 03:54:48.082 WARN failed to register with Nexus, will retry, error: proto error: no records found for Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, delay: 135.785811ms, count: 1, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
1842026-08-22T03:54:48.123ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:59205 unit = api_server
1852026-08-22T03:54:48.123ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59205 req_id = 759be7d1-2e98-4935-9a61-42eed7eebf0f unit = api_server uri = /static/route4 version = 12.0.0
1862026-08-22T03:54:48.123ZINFOslog-rs (mgd): request completed latency_us = 188 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59205 req_id = 759be7d1-2e98-4935-9a61-42eed7eebf0f response_code = 200 unit = api_server uri = /static/route4
1872026-08-22T03:54:48.124ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59205 req_id = bc536183-9984-4fda-a577-0c9bbfbe0739 unit = api_server uri = /static/route6 version = 12.0.0
1882026-08-22T03:54:48.124ZINFOslog-rs (mgd): request completed latency_us = 109 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59205 req_id = bc536183-9984-4fda-a577-0c9bbfbe0739 response_code = 200 unit = api_server uri = /static/route6
1892026-08-22T03:54:48.124ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = PUT module = admin remote_addr = [fd00:1122:3344:101::1]:59205 req_id = 87556f57-d3fc-44bb-aca8-ea9839b17c47 unit = api_server uri = /static/route4 version = 12.0.0
1902026-08-22T03:54:48.125ZINFOslog-rs (mgd): request completed latency_us = 596 local_addr = [::]:4676 method = PUT module = admin remote_addr = [fd00:1122:3344:101::1]:59205 req_id = 87556f57-d3fc-44bb-aca8-ea9839b17c47 response_code = 204 unit = api_server uri = /static/route4
1912026-08-22T03:54:48.125ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59205 req_id = d4fef24b-3f28-4942-b288-0b067373b3eb unit = api_server uri = /bgp/config/routers version = 12.0.0
1922026-08-22T03:54:48.125ZINFOslog-rs (mgd): request completed latency_us = 74 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59205 req_id = d4fef24b-3f28-4942-b288-0b067373b3eb response_code = 200 unit = api_server uri = /bgp/config/routers
1932026-08-22T03:54:48.125ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59205 req_id = ef98518a-3fc5-43d8-85a6-ba2b30b3bd88 unit = api_server uri = /bfd/peers version = 12.0.0
1942026-08-22T03:54:48.125ZINFOslog-rs (mgd): request completed latency_us = 162 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59205 req_id = ef98518a-3fc5-43d8-85a6-ba2b30b3bd88 response_code = 200 unit = api_server uri = /bfd/peers
1952026-08-22T03:54:48.127ZERROslog-rs (mg-lower): handling change failed: route lookup error io error No such process (os error 3) error = route lookup error io error No such process (os error 3) module = sync unit = event_loop
1962026-08-22T03:54:48.127ZINFOslog-rs (mg-lower): restarting sync loop module = sync unit = event_loop
197 Aug 22 03:54:48.792 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3889b162-1ea5-494e-aef3-4a60896b5f8e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3d9204e7-7d0c-45a3-9576-1e9bafef0cc6.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b1534826-8fb3-422b-965e-b6a7f66bafa3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("b1534826-8fb3-422b-965e-b6a7f66bafa3.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 727, tv_nsec: 493536956 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
198 Aug 22 03:54:48.793 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
199 Aug 22 03:54:48.794 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
2002026-08-22T03:54:49.128ZERROslog-rs (mg-lower): initialization failed: route lookup error io error No such process (os error 3) error = route lookup error io error No such process (os error 3) module = sync unit = event_loop
2012026-08-22T03:54:49.128ZINFOslog-rs (mg-lower): restarting sync loop in one second module = sync unit = event_loop
2022026-08-22T03:54:55.309ZDEBGslog-rs: client request body = None method = GET unit = gateway-client uri = http://[::1]:12225/local/switch-id
2032026-08-22T03:54:55.310ZDEBGslog-rs: client response result = Ok(Response { url: "http://[::1]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "50b2f158-9ef0-42e8-97d8-c14eb288046a", "content-length": "26", "date": "Sat, 22 Aug 2026 03:54:55 GMT"} }) unit = gateway-client
2042026-08-22T03:54:55.310ZINFOslog-rs: we are in switch slot 0
205 Aug 22 03:55:03.412 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
206 Aug 22 03:55:03.412 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 15.848287268s, count: 2, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
207 Aug 22 03:55:04.424 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3889b162-1ea5-494e-aef3-4a60896b5f8e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3d9204e7-7d0c-45a3-9576-1e9bafef0cc6.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b1534826-8fb3-422b-965e-b6a7f66bafa3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("b1534826-8fb3-422b-965e-b6a7f66bafa3.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 743, tv_nsec: 968979256 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
208 Aug 22 03:55:04.424 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
209 Aug 22 03:55:04.425 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
2102026-08-22T03:55:17.317ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:45851 unit = api_server
2112026-08-22T03:55:17.318ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:45851 req_id = 8bd22155-f5f5-4102-8c4b-422f8c0646a3 unit = api_server uri = /static/route4 version = 12.0.0
2122026-08-22T03:55:17.318ZINFOslog-rs (mgd): request completed latency_us = 206 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:45851 req_id = 8bd22155-f5f5-4102-8c4b-422f8c0646a3 response_code = 200 unit = api_server uri = /static/route4
2132026-08-22T03:55:17.318ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:45851 req_id = bc90f197-f2a2-4f85-9876-cb75ea055c34 unit = api_server uri = /static/route6 version = 12.0.0
2142026-08-22T03:55:17.318ZINFOslog-rs (mgd): request completed latency_us = 70 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:45851 req_id = bc90f197-f2a2-4f85-9876-cb75ea055c34 response_code = 200 unit = api_server uri = /static/route6
2152026-08-22T03:55:17.319ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:45851 req_id = 1a518991-12ac-4d38-873b-26defd53e2b8 unit = api_server uri = /bgp/config/routers version = 12.0.0
2162026-08-22T03:55:17.319ZINFOslog-rs (mgd): request completed latency_us = 41 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:45851 req_id = 1a518991-12ac-4d38-873b-26defd53e2b8 response_code = 200 unit = api_server uri = /bgp/config/routers
2172026-08-22T03:55:17.319ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:45851 req_id = 27193498-cc50-473f-b1eb-d327b08ad93f unit = api_server uri = /bfd/peers version = 12.0.0
2182026-08-22T03:55:17.319ZINFOslog-rs (mgd): request completed latency_us = 37 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:45851 req_id = 27193498-cc50-473f-b1eb-d327b08ad93f response_code = 200 unit = api_server uri = /bfd/peers
219 Aug 22 03:55:19.467 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
220 Aug 22 03:55:19.467 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 32.323531087s, count: 3, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
221 Aug 22 03:55:21.880 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3889b162-1ea5-494e-aef3-4a60896b5f8e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3d9204e7-7d0c-45a3-9576-1e9bafef0cc6.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b1534826-8fb3-422b-965e-b6a7f66bafa3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("b1534826-8fb3-422b-965e-b6a7f66bafa3.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 761, tv_nsec: 377839543 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
222 Aug 22 03:55:21.880 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
223 Aug 22 03:55:21.881 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
224 Aug 22 03:55:36.923 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
225 Aug 22 03:55:36.923 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 49.732694608s, count: 4, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
226 Aug 22 03:55:39.378 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3889b162-1ea5-494e-aef3-4a60896b5f8e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3d9204e7-7d0c-45a3-9576-1e9bafef0cc6.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b1534826-8fb3-422b-965e-b6a7f66bafa3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("b1534826-8fb3-422b-965e-b6a7f66bafa3.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 778, tv_nsec: 829336900 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
227 Aug 22 03:55:39.379 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
228 Aug 22 03:55:39.380 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
2292026-08-22T03:55:47.402ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:56176 unit = api_server
2302026-08-22T03:55:47.403ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56176 req_id = 6bcf61e0-8d0c-43bf-99f8-88b9db15b557 unit = api_server uri = /static/route4 version = 12.0.0
2312026-08-22T03:55:47.403ZINFOslog-rs (mgd): request completed latency_us = 92 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56176 req_id = 6bcf61e0-8d0c-43bf-99f8-88b9db15b557 response_code = 200 unit = api_server uri = /static/route4
2322026-08-22T03:55:47.403ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56176 req_id = 445c574d-1dfb-4fa0-9385-3e4d13bbc01b unit = api_server uri = /static/route6 version = 12.0.0
2332026-08-22T03:55:47.403ZINFOslog-rs (mgd): request completed latency_us = 71 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56176 req_id = 445c574d-1dfb-4fa0-9385-3e4d13bbc01b response_code = 200 unit = api_server uri = /static/route6
2342026-08-22T03:55:47.403ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56176 req_id = 18c79f3d-21b2-41b1-96cb-1b99b044b401 unit = api_server uri = /bgp/config/routers version = 12.0.0
2352026-08-22T03:55:47.403ZINFOslog-rs (mgd): request completed latency_us = 42 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56176 req_id = 18c79f3d-21b2-41b1-96cb-1b99b044b401 response_code = 200 unit = api_server uri = /bgp/config/routers
2362026-08-22T03:55:47.404ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56176 req_id = 8c83562e-6031-4646-ba48-baf325672664 unit = api_server uri = /bfd/peers version = 12.0.0
2372026-08-22T03:55:47.404ZINFOslog-rs (mgd): request completed latency_us = 36 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56176 req_id = 8c83562e-6031-4646-ba48-baf325672664 response_code = 200 unit = api_server uri = /bfd/peers
238 Aug 22 03:55:54.422 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
239 Aug 22 03:55:54.422 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 67.18434986s, count: 5, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
240 Aug 22 03:56:02.854 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3889b162-1ea5-494e-aef3-4a60896b5f8e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3d9204e7-7d0c-45a3-9576-1e9bafef0cc6.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b1534826-8fb3-422b-965e-b6a7f66bafa3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("b1534826-8fb3-422b-965e-b6a7f66bafa3.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 802, tv_nsec: 241673044 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
241 Aug 22 03:56:02.855 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
242 Aug 22 03:56:02.856 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
2432026-08-22T03:56:17.487ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:60863 unit = api_server
2442026-08-22T03:56:17.487ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:60863 req_id = f2749afc-5549-4077-9083-901d1a479ec7 unit = api_server uri = /static/route4 version = 12.0.0
2452026-08-22T03:56:17.487ZINFOslog-rs (mgd): request completed latency_us = 88 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:60863 req_id = f2749afc-5549-4077-9083-901d1a479ec7 response_code = 200 unit = api_server uri = /static/route4
2462026-08-22T03:56:17.487ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:60863 req_id = f88d682b-b1cb-4e9b-8920-e1f3aae0ca30 unit = api_server uri = /static/route6 version = 12.0.0
2472026-08-22T03:56:17.487ZINFOslog-rs (mgd): request completed latency_us = 78 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:60863 req_id = f88d682b-b1cb-4e9b-8920-e1f3aae0ca30 response_code = 200 unit = api_server uri = /static/route6
2482026-08-22T03:56:17.488ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:60863 req_id = b715ea32-747f-4f18-a19b-f534bb59c15b unit = api_server uri = /bgp/config/routers version = 12.0.0
2492026-08-22T03:56:17.488ZINFOslog-rs (mgd): request completed latency_us = 36 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:60863 req_id = b715ea32-747f-4f18-a19b-f534bb59c15b response_code = 200 unit = api_server uri = /bgp/config/routers
2502026-08-22T03:56:17.488ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:60863 req_id = 01084a89-b288-4dd6-ac1a-6fb723f6563c unit = api_server uri = /bfd/peers version = 12.0.0
2512026-08-22T03:56:17.488ZINFOslog-rs (mgd): request completed latency_us = 37 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:60863 req_id = 01084a89-b288-4dd6-ac1a-6fb723f6563c response_code = 200 unit = api_server uri = /bfd/peers
252 Aug 22 03:56:17.898 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
253 Aug 22 03:56:17.898 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 90.596412197s, count: 6, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
254 Aug 22 03:56:34.609 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3889b162-1ea5-494e-aef3-4a60896b5f8e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3d9204e7-7d0c-45a3-9576-1e9bafef0cc6.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b1534826-8fb3-422b-965e-b6a7f66bafa3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("b1534826-8fb3-422b-965e-b6a7f66bafa3.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 833, tv_nsec: 910115941 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
255 Aug 22 03:56:34.610 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
256 Aug 22 03:56:34.611 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
2572026-08-22T03:56:47.571ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:34631 unit = api_server
2582026-08-22T03:56:47.571ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:34631 req_id = ba63ed5b-1a3f-49cd-bb96-12b2fcaa2088 unit = api_server uri = /static/route4 version = 12.0.0
2592026-08-22T03:56:47.571ZINFOslog-rs (mgd): request completed latency_us = 154 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:34631 req_id = ba63ed5b-1a3f-49cd-bb96-12b2fcaa2088 response_code = 200 unit = api_server uri = /static/route4
2602026-08-22T03:56:47.571ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:34631 req_id = 8847d03b-efeb-43ad-a031-70caa1deb578 unit = api_server uri = /static/route6 version = 12.0.0
2612026-08-22T03:56:47.571ZINFOslog-rs (mgd): request completed latency_us = 102 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:34631 req_id = 8847d03b-efeb-43ad-a031-70caa1deb578 response_code = 200 unit = api_server uri = /static/route6
2622026-08-22T03:56:47.572ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:34631 req_id = d54accc1-80b0-4259-9d59-8483bc7e46fa unit = api_server uri = /bgp/config/routers version = 12.0.0
2632026-08-22T03:56:47.572ZINFOslog-rs (mgd): request completed latency_us = 76 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:34631 req_id = d54accc1-80b0-4259-9d59-8483bc7e46fa response_code = 200 unit = api_server uri = /bgp/config/routers
2642026-08-22T03:56:47.572ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:34631 req_id = 29047d0b-9529-4b77-9318-166e6531e0ce unit = api_server uri = /bfd/peers version = 12.0.0
2652026-08-22T03:56:47.572ZINFOslog-rs (mgd): request completed latency_us = 37 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:34631 req_id = 29047d0b-9529-4b77-9318-166e6531e0ce response_code = 200 unit = api_server uri = /bfd/peers
266 Aug 22 03:56:49.653 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
267 Aug 22 03:56:49.653 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 122.265370424s, count: 7, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
2682026-08-22T03:57:17.624ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:43449 unit = api_server
2692026-08-22T03:57:17.624ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:43449 req_id = ac29c672-c672-4a1f-925a-9043352b8d1b unit = api_server uri = /static/route4 version = 12.0.0
2702026-08-22T03:57:17.624ZINFOslog-rs (mgd): request completed latency_us = 83 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:43449 req_id = ac29c672-c672-4a1f-925a-9043352b8d1b response_code = 200 unit = api_server uri = /static/route4
2712026-08-22T03:57:17.624ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:43449 req_id = 8cf3c6f4-0829-4f16-9cb6-fa25799c5421 unit = api_server uri = /static/route6 version = 12.0.0
2722026-08-22T03:57:17.624ZINFOslog-rs (mgd): request completed latency_us = 70 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:43449 req_id = 8cf3c6f4-0829-4f16-9cb6-fa25799c5421 response_code = 200 unit = api_server uri = /static/route6
2732026-08-22T03:57:17.625ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:43449 req_id = e883947d-23af-4b0f-9885-6c5adce9efd8 unit = api_server uri = /bgp/config/routers version = 12.0.0
2742026-08-22T03:57:17.625ZINFOslog-rs (mgd): request completed latency_us = 43 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:43449 req_id = e883947d-23af-4b0f-9885-6c5adce9efd8 response_code = 200 unit = api_server uri = /bgp/config/routers
2752026-08-22T03:57:17.625ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:43449 req_id = f0340c7e-16ca-4970-859f-03580ccdc979 unit = api_server uri = /bfd/peers version = 12.0.0
2762026-08-22T03:57:17.625ZINFOslog-rs (mgd): request completed latency_us = 38 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:43449 req_id = f0340c7e-16ca-4970-859f-03580ccdc979 response_code = 200 unit = api_server uri = /bfd/peers
277 Aug 22 03:57:25.172 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3889b162-1ea5-494e-aef3-4a60896b5f8e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3d9204e7-7d0c-45a3-9576-1e9bafef0cc6.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b1534826-8fb3-422b-965e-b6a7f66bafa3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("b1534826-8fb3-422b-965e-b6a7f66bafa3.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 884, tv_nsec: 387070816 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
278 Aug 22 03:57:25.173 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
279 Aug 22 03:57:25.174 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
280 Aug 22 03:57:40.175 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
281 Aug 22 03:57:40.175 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 172.741861971s, count: 8, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
2822026-08-22T03:57:47.626ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:57248 unit = api_server
2832026-08-22T03:57:47.626ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:57248 req_id = ba3c73a4-11d9-4fc6-9174-a91d7fb8aa0c unit = api_server uri = /static/route4 version = 12.0.0
2842026-08-22T03:57:47.626ZINFOslog-rs (mgd): request completed latency_us = 88 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:57248 req_id = ba3c73a4-11d9-4fc6-9174-a91d7fb8aa0c response_code = 200 unit = api_server uri = /static/route4
2852026-08-22T03:57:47.626ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:57248 req_id = 56e018b2-42d2-4227-95e1-c0ecd5d9f671 unit = api_server uri = /static/route6 version = 12.0.0
2862026-08-22T03:57:47.626ZINFOslog-rs (mgd): request completed latency_us = 103 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:57248 req_id = 56e018b2-42d2-4227-95e1-c0ecd5d9f671 response_code = 200 unit = api_server uri = /static/route6
2872026-08-22T03:57:47.627ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:57248 req_id = 847ffdb6-38a6-4932-9cc4-397bf8bdd859 unit = api_server uri = /bgp/config/routers version = 12.0.0
2882026-08-22T03:57:47.627ZINFOslog-rs (mgd): request completed latency_us = 74 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:57248 req_id = 847ffdb6-38a6-4932-9cc4-397bf8bdd859 response_code = 200 unit = api_server uri = /bgp/config/routers
2892026-08-22T03:57:47.627ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:57248 req_id = 214a8cc6-932d-4387-b9f6-66b9be25931f unit = api_server uri = /bfd/peers version = 12.0.0
2902026-08-22T03:57:47.627ZINFOslog-rs (mgd): request completed latency_us = 35 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:57248 req_id = 214a8cc6-932d-4387-b9f6-66b9be25931f response_code = 200 unit = api_server uri = /bfd/peers
291 Aug 22 03:58:13.042 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3889b162-1ea5-494e-aef3-4a60896b5f8e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3d9204e7-7d0c-45a3-9576-1e9bafef0cc6.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b1534826-8fb3-422b-965e-b6a7f66bafa3.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("b1534826-8fb3-422b-965e-b6a7f66bafa3.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 932, tv_nsec: 255914142 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
292 Aug 22 03:58:13.043 DEBG will register with Nexus at [fd00:1122:3344:101::c]:12221, component: producer-registration-task
293 Aug 22 03:58:13.045 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST, component: producer-registration-task
2942026-08-22T03:58:19.834ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:57419 unit = api_server
2952026-08-22T03:58:19.973ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:57419 req_id = 85df91cf-33c4-4102-ad27-895b0b2707da unit = api_server uri = /static/route4 version = 12.0.0
2962026-08-22T03:58:20.348ZINFOslog-rs (mgd): request completed latency_us = 427093 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:57419 req_id = 85df91cf-33c4-4102-ad27-895b0b2707da response_code = 200 unit = api_server uri = /static/route4
2972026-08-22T03:58:20.353ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:57419 req_id = 0b7613b3-fca6-4367-874d-8bdb764f88c7 unit = api_server uri = /static/route6 version = 12.0.0
2982026-08-22T03:58:20.355ZINFOslog-rs (mgd): request completed latency_us = 1998 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:57419 req_id = 0b7613b3-fca6-4367-874d-8bdb764f88c7 response_code = 200 unit = api_server uri = /static/route6
2992026-08-22T03:58:20.369ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:57419 req_id = d75ac347-3213-42f7-af0a-41a1a2c7c574 unit = api_server uri = /bgp/config/routers version = 12.0.0
3002026-08-22T03:58:20.373ZINFOslog-rs (mgd): request completed latency_us = 6957 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:57419 req_id = d75ac347-3213-42f7-af0a-41a1a2c7c574 response_code = 200 unit = api_server uri = /bgp/config/routers
3012026-08-22T03:58:20.374ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:57419 req_id = 9534adf7-a28b-4f30-9b80-b420d8c698b8 unit = api_server uri = /bfd/peers version = 12.0.0
3022026-08-22T03:58:20.381ZINFOslog-rs (mgd): request completed latency_us = 7109 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:57419 req_id = 9534adf7-a28b-4f30-9b80-b420d8c698b8 response_code = 200 unit = api_server uri = /bfd/peers
303 Aug 22 03:58:28.054 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
304 Aug 22 03:58:28.058 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out, delay: 220.621219377s, count: 9, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
3052026-08-22T03:58:50.383ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:43949 unit = api_server
3062026-08-22T03:58:50.384ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:43949 req_id = 6741c51b-414d-4971-a30f-02a698e6ea24 unit = api_server uri = /static/route4 version = 12.0.0
3072026-08-22T03:58:50.389ZINFOslog-rs (mgd): request completed latency_us = 5364 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:43949 req_id = 6741c51b-414d-4971-a30f-02a698e6ea24 response_code = 200 unit = api_server uri = /static/route4
3082026-08-22T03:58:50.396ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:43949 req_id = 14601ed2-a878-492d-a473-5f6e5b7d76c4 unit = api_server uri = /static/route6 version = 12.0.0
3092026-08-22T03:58:50.396ZINFOslog-rs (mgd): request completed latency_us = 124 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:43949 req_id = 14601ed2-a878-492d-a473-5f6e5b7d76c4 response_code = 200 unit = api_server uri = /static/route6
3102026-08-22T03:58:50.396ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:43949 req_id = 91bed046-032a-452b-8148-a095fcf8aa67 unit = api_server uri = /bgp/config/routers version = 12.0.0
3112026-08-22T03:58:50.397ZINFOslog-rs (mgd): request completed latency_us = 347 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:43949 req_id = 91bed046-032a-452b-8148-a095fcf8aa67 response_code = 200 unit = api_server uri = /bgp/config/routers
3122026-08-22T03:58:50.397ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:43949 req_id = 3fcdd66b-5afd-4870-a0d5-2ba8dedc941a unit = api_server uri = /bfd/peers version = 12.0.0
3132026-08-22T03:58:50.397ZINFOslog-rs (mgd): request completed latency_us = 103 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:43949 req_id = 3fcdd66b-5afd-4870-a0d5-2ba8dedc941a response_code = 200 unit = api_server uri = /bfd/peers
3142026-08-22T03:59:20.400ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:42319 unit = api_server
3152026-08-22T03:59:20.400ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:42319 req_id = 7c55dde1-07b6-4d17-9f6b-736ed0ec8946 unit = api_server uri = /static/route4 version = 12.0.0
3162026-08-22T03:59:20.400ZINFOslog-rs (mgd): request completed latency_us = 66 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:42319 req_id = 7c55dde1-07b6-4d17-9f6b-736ed0ec8946 response_code = 200 unit = api_server uri = /static/route4
3172026-08-22T03:59:20.400ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:42319 req_id = 4d2d8e44-6130-49dc-8f05-e7caad7c5184 unit = api_server uri = /static/route6 version = 12.0.0
3182026-08-22T03:59:20.400ZINFOslog-rs (mgd): request completed latency_us = 67 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:42319 req_id = 4d2d8e44-6130-49dc-8f05-e7caad7c5184 response_code = 200 unit = api_server uri = /static/route6
3192026-08-22T03:59:20.400ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:42319 req_id = fbed7291-7903-414a-8c55-35d4bb695866 unit = api_server uri = /bgp/config/routers version = 12.0.0
3202026-08-22T03:59:20.400ZINFOslog-rs (mgd): request completed latency_us = 34 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:42319 req_id = fbed7291-7903-414a-8c55-35d4bb695866 response_code = 200 unit = api_server uri = /bgp/config/routers
3212026-08-22T03:59:20.400ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:42319 req_id = 5fec1026-1012-4016-9177-6d8898ba2278 unit = api_server uri = /bfd/peers version = 12.0.0
3222026-08-22T03:59:20.400ZINFOslog-rs (mgd): request completed latency_us = 34 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:42319 req_id = 5fec1026-1012-4016-9177-6d8898ba2278 response_code = 200 unit = api_server uri = /bfd/peers
3232026-08-22T03:59:42.643ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:45504 unit = api_server
3242026-08-22T03:59:42.645ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:45504 req_id = 0f04ff75-c20d-4904-940e-137ac80e0d64 unit = api_server uri = /static/route4 version = 12.0.0
3252026-08-22T03:59:42.645ZINFOslog-rs (mgd): request completed latency_us = 91 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:45504 req_id = 0f04ff75-c20d-4904-940e-137ac80e0d64 response_code = 200 unit = api_server uri = /static/route4
3262026-08-22T03:59:42.645ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:45504 req_id = 080148ed-fb33-44b4-b14b-768244dd2c78 unit = api_server uri = /static/route6 version = 12.0.0
3272026-08-22T03:59:42.645ZINFOslog-rs (mgd): request completed latency_us = 62 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:45504 req_id = 080148ed-fb33-44b4-b14b-768244dd2c78 response_code = 200 unit = api_server uri = /static/route6
3282026-08-22T03:59:42.645ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:45504 req_id = ad6a774f-dbe6-4d0e-adec-e8860bcbac7e unit = api_server uri = /bgp/config/routers version = 12.0.0
3292026-08-22T03:59:42.645ZINFOslog-rs (mgd): request completed latency_us = 48 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:45504 req_id = ad6a774f-dbe6-4d0e-adec-e8860bcbac7e response_code = 200 unit = api_server uri = /bgp/config/routers
3302026-08-22T03:59:42.645ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:45504 req_id = 3d130bfe-e368-485c-9703-ec7c60f3dc05 unit = api_server uri = /bfd/peers version = 12.0.0
3312026-08-22T03:59:42.645ZINFOslog-rs (mgd): request completed latency_us = 28 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:45504 req_id = 3d130bfe-e368-485c-9703-ec7c60f3dc05 response_code = 200 unit = api_server uri = /bfd/peers