Max level shown:
1 [ Sep 8 19:40:53 Disabled. ]
2 [ Sep 8 19:40:53 Rereading configuration. ]
3 [ Sep 8 19:40:55 Enabled. ]
4 [ Sep 8 19:40:55 Rereading configuration. ]
5 [ Sep 8 19:40:55 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/mgd/pkg/mgd_method_script.sh &"). ]
6 [ Sep 8 19:40:55 Method "start" exited with status 0. ]
72026-09-08T19:40:55.236ZINFOslog-rs (mgd): signal handler waiting for context module = admin unit = signal
82026-09-08T19:40:55.264ZINFOslog-rs (mgd): interface monitor started module = unnumbered manager unit = daemon
92026-09-08T19:40:55.264ZINFOslog-rs (bgp): dispatcher started module = neighbor unit = dispatcher
102026-09-08T19:40:55.265ZINFOslog-rs (bgp): starting listener with bind arg: [::]:179 module = neighbor unit = dispatcher
112026-09-08T19:40:55.265ZINFOslog-rs (bgp): TcpListener created listener = TcpListener { addr: [::]:179, fd: 10 } module = neighbor unit = dispatcher
122026-09-08T19:40:55.265ZINFOslog-rs (bgp): transitioning to accept loop bind_addr = [::]:179 module = neighbor unit = dispatcher
132026-09-08T19:40:55.265ZINFOslog-rs (mgd): signal handler got context module = admin unit = signal
142026-09-08T19:40:55.268ZDEBGslog-rs: client request body = None method = GET unit = gateway-client uri = http://[::1]:12225/local/switch-id
152026-09-08T19:40:55.269ZDEBGslog-rs: client response result = Err(reqwest::Error { kind: Request, url: "http://[::1]:12225/local/switch-id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:12225, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) }) unit = gateway-client
162026-09-08T19:40:55.269ZERROslog-rs: failed to resolve switch slot error = Communication Error: error sending request for url (http://[::1]:12225/local/switch-id)
172026-09-08T19:40:55.269ZINFOslog-rs (mgd): starting bgp routers: {} module = admin unit = daemon
182026-09-08T19:40:55.269ZINFOslog-rs (mgd): starting bfd sessions: [] module = admin unit = daemon
192026-09-08T19:40:55.270ZERROslog-rs (mgd): failed to start stats server: underlay address not found error = underlay address not found module = admin params = hostname oxz_switch, rack 70de959b-e2e4-4dbf-9adc-5ed37ffe89c9, sled 258addde-7bc4-4a5e-acdb-768cf4c600b1 unit = daemon
202026-09-08T19:40:55.270ZWARNslog-rs (mg-lower): failed to ensure TEP address fdaa:84ee:34d2:e013::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fdaa:84ee:34d2:e013::1 unit = dpd
212026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bestpath/config/fanout unit = api_server versions = all ending with 2.0.0
222026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bestpath/config/fanout unit = api_server versions = all ending with 2.0.0
232026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bfd/peers unit = api_server versions = all starting from 12.0.0
242026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bfd/peers unit = api_server versions = from 1.0.0 to 12.0.0
252026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bfd/peers unit = api_server versions = all starting from 12.0.0
262026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bfd/peers unit = api_server versions = from 1.0.0 to 12.0.0
272026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bfd/peers/{addr} unit = api_server versions = all
282026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/clear/neighbor unit = api_server versions = all starting from 4.0.0
292026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/clear/neighbor unit = api_server versions = all ending with 4.0.0
302026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/clear/unnumbered-neighbor unit = api_server versions = all starting from 5.0.0
312026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/checker unit = api_server versions = all
322026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/checker unit = api_server versions = all
332026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/checker unit = api_server versions = all
342026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/checker unit = api_server versions = all
352026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/neighbor unit = api_server versions = all ending with 5.0.0
362026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbor unit = api_server versions = from 4.0.0 to 5.0.0
372026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbor unit = api_server versions = all ending with 4.0.0
382026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/neighbor unit = api_server versions = all starting from 11.0.0
392026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/neighbor unit = api_server versions = from 8.0.0 to 11.0.0
402026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/neighbor unit = api_server versions = from 4.0.0 to 8.0.0
412026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/neighbor unit = api_server versions = all ending with 4.0.0
422026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/neighbor unit = api_server versions = all starting from 11.0.0
432026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/neighbor unit = api_server versions = from 8.0.0 to 11.0.0
442026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/neighbor unit = api_server versions = from 4.0.0 to 8.0.0
452026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/neighbor unit = api_server versions = all ending with 4.0.0
462026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/neighbor/{asn}/{peer} unit = api_server versions = all starting from 5.0.0
472026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbor/{asn}/{peer} unit = api_server versions = all starting from 11.0.0
482026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbor/{asn}/{peer} unit = api_server versions = from 8.0.0 to 11.0.0
492026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbor/{asn}/{peer} unit = api_server versions = from 5.0.0 to 8.0.0
502026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbors unit = api_server versions = from 4.0.0 to 5.0.0
512026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbors unit = api_server versions = all ending with 4.0.0
522026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbors/{asn} unit = api_server versions = all starting from 11.0.0
532026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbors/{asn} unit = api_server versions = from 8.0.0 to 11.0.0
542026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/neighbors/{asn} unit = api_server versions = from 5.0.0 to 8.0.0
552026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/origin4 unit = api_server versions = all
562026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/origin4 unit = api_server versions = all starting from 11.0.0
572026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/origin4 unit = api_server versions = all ending with 11.0.0
582026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/origin4 unit = api_server versions = all starting from 11.0.0
592026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/origin4 unit = api_server versions = all ending with 11.0.0
602026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/origin4 unit = api_server versions = all starting from 11.0.0
612026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/origin4 unit = api_server versions = all ending with 11.0.0
622026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/origin6 unit = api_server versions = all starting from 2.0.0
632026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/origin6 unit = api_server versions = all starting from 11.0.0
642026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/origin6 unit = api_server versions = from 2.0.0 to 11.0.0
652026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/origin6 unit = api_server versions = all starting from 11.0.0
662026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/origin6 unit = api_server versions = from 2.0.0 to 11.0.0
672026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/origin6 unit = api_server versions = all starting from 11.0.0
682026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/origin6 unit = api_server versions = from 2.0.0 to 11.0.0
692026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/router unit = api_server versions = all
702026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/router unit = api_server versions = all
712026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/router unit = api_server versions = all
722026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/router unit = api_server versions = all
732026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/routers unit = api_server versions = all
742026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/shaper unit = api_server versions = all
752026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/shaper unit = api_server versions = all
762026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/shaper unit = api_server versions = all
772026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/shaper unit = api_server versions = all
782026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = all starting from 5.0.0
792026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = all starting from 11.0.0
802026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = from 8.0.0 to 11.0.0
812026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = from 5.0.0 to 8.0.0
822026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = all starting from 11.0.0
832026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = from 8.0.0 to 11.0.0
842026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = from 5.0.0 to 8.0.0
852026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = all starting from 11.0.0
862026-09-08T19:40:55.272ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = from 8.0.0 to 11.0.0
872026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /bgp/config/unnumbered-neighbor unit = api_server versions = from 5.0.0 to 8.0.0
882026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/unnumbered-neighbors unit = api_server versions = all starting from 11.0.0
892026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/unnumbered-neighbors unit = api_server versions = from 8.0.0 to 11.0.0
902026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/config/unnumbered-neighbors unit = api_server versions = from 5.0.0 to 8.0.0
912026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/history/fsm unit = api_server versions = all starting from 5.0.0
922026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/history/fsm unit = api_server versions = from 2.0.0 to 5.0.0
932026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/history/message unit = api_server versions = all starting from 11.0.0
942026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/history/message unit = api_server versions = from 5.0.0 to 11.0.0
952026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/history/message unit = api_server versions = from 4.0.0 to 5.0.0
962026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/history/message unit = api_server versions = from 2.0.0 to 4.0.0
972026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/message-history unit = api_server versions = all ending with 2.0.0
982026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/omicron/apply unit = api_server versions = all starting from 11.0.0
992026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/omicron/apply unit = api_server versions = from 8.0.0 to 11.0.0
1002026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/omicron/apply unit = api_server versions = from 4.0.0 to 8.0.0
1012026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /bgp/omicron/apply unit = api_server versions = all ending with 4.0.0
1022026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/exported unit = api_server versions = all starting from 11.0.0
1032026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/exported unit = api_server versions = from 6.0.0 to 11.0.0
1042026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/exported unit = api_server versions = from 5.0.0 to 6.0.0
1052026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/exported unit = api_server versions = all ending with 5.0.0
1062026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/imported unit = api_server versions = all ending with 2.0.0
1072026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/neighbors unit = api_server versions = all starting from 11.0.0
1082026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/neighbors unit = api_server versions = from 5.0.0 to 11.0.0
1092026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/neighbors unit = api_server versions = from 4.0.0 to 5.0.0
1102026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/neighbors unit = api_server versions = from 2.0.0 to 4.0.0
1112026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/neighbors unit = api_server versions = all ending with 2.0.0
1122026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /bgp/status/selected unit = api_server versions = all ending with 2.0.0
1132026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /ndp/interface unit = api_server versions = all starting from 5.0.0
1142026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /ndp/interfaces unit = api_server versions = all starting from 5.0.0
1152026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /ndp/manager unit = api_server versions = all starting from 5.0.0
1162026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /rib/config/bestpath/fanout unit = api_server versions = all starting from 2.0.0
1172026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = POST module = admin path = /rib/config/bestpath/fanout unit = api_server versions = all starting from 2.0.0
1182026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /rib/status/imported unit = api_server versions = all starting from 5.0.0
1192026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /rib/status/imported unit = api_server versions = from 2.0.0 to 5.0.0
1202026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /rib/status/selected unit = api_server versions = all starting from 5.0.0
1212026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /rib/status/selected unit = api_server versions = from 2.0.0 to 5.0.0
1222026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /static/route4 unit = api_server versions = all starting from 11.0.0
1232026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /static/route4 unit = api_server versions = from 10.0.0 to 11.0.0
1242026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /static/route4 unit = api_server versions = all ending with 10.0.0
1252026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /static/route4 unit = api_server versions = all starting from 5.0.0
1262026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /static/route4 unit = api_server versions = all ending with 5.0.0
1272026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /static/route4 unit = api_server versions = all starting from 11.0.0
1282026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /static/route4 unit = api_server versions = from 10.0.0 to 11.0.0
1292026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /static/route4 unit = api_server versions = all ending with 10.0.0
1302026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /static/route6 unit = api_server versions = all starting from 11.0.0
1312026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = DELETE module = admin path = /static/route6 unit = api_server versions = from 2.0.0 to 11.0.0
1322026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /static/route6 unit = api_server versions = all starting from 5.0.0
1332026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /static/route6 unit = api_server versions = from 2.0.0 to 5.0.0
1342026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /static/route6 unit = api_server versions = all starting from 11.0.0
1352026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = PUT module = admin path = /static/route6 unit = api_server versions = from 2.0.0 to 11.0.0
1362026-09-08T19:40:55.273ZDEBGslog-rs (mgd): registered endpoint local_addr = [::]:4676 method = GET module = admin path = /switch/identifiers unit = api_server versions = all starting from 3.0.0
1372026-09-08T19:40:55.273ZINFOslog-rs (mgd): listening local_addr = [::]:4676 module = admin unit = api_server
1382026-09-08T19:40:55.273ZDEBGslog-rs (mgd): successfully registered DTrace USDT probes local_addr = [::]:4676 module = admin unit = api_server
1392026-09-08T19:40:55.273ZINFOslog-rs: listening on [::]:4676
1402026-09-08T19:40:56.271ZWARNslog-rs (mg-lower): failed to ensure TEP address fdaa:84ee:34d2:e013::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fdaa:84ee:34d2:e013::1 unit = dpd
1412026-09-08T19:40:57.271ZWARNslog-rs (mg-lower): failed to ensure TEP address fdaa:84ee:34d2:e013::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fdaa:84ee:34d2:e013::1 unit = dpd
1422026-09-08T19:40:58.272ZWARNslog-rs (mg-lower): failed to ensure TEP address fdaa:84ee:34d2:e013::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fdaa:84ee:34d2:e013::1 unit = dpd
1432026-09-08T19:40:59.272ZWARNslog-rs (mg-lower): failed to ensure TEP address fdaa:84ee:34d2:e013::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fdaa:84ee:34d2:e013::1 unit = dpd
1442026-09-08T19:41:00.273ZWARNslog-rs (mg-lower): failed to ensure TEP address fdaa:84ee:34d2:e013::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fdaa:84ee:34d2:e013::1 unit = dpd
1452026-09-08T19:41:01.287ZWARNslog-rs (mg-lower): failed to ensure TEP address fdaa:84ee:34d2:e013::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fdaa:84ee:34d2:e013::1 unit = dpd
1462026-09-08T19:41:02.286ZWARNslog-rs (mg-lower): failed to ensure TEP address fdaa:84ee:34d2:e013::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fdaa:84ee:34d2:e013::1 unit = dpd
1472026-09-08T19:41:03.287ZWARNslog-rs (mg-lower): failed to ensure TEP address fdaa:84ee:34d2:e013::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fdaa:84ee:34d2:e013::1 unit = dpd
1482026-09-08T19:41:04.287ZWARNslog-rs (mg-lower): failed to ensure TEP address fdaa:84ee:34d2:e013::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fdaa:84ee:34d2:e013::1 unit = dpd
1492026-09-08T19:41:05.270ZDEBGslog-rs: client request body = None method = GET unit = gateway-client uri = http://[::1]:12225/local/switch-id
1502026-09-08T19:41:05.270ZDEBGslog-rs: client response result = Err(reqwest::Error { kind: Request, url: "http://[::1]:12225/local/switch-id", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [::1]:12225, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) }) unit = gateway-client
1512026-09-08T19:41:05.270ZERROslog-rs: failed to resolve switch slot error = Communication Error: error sending request for url (http://[::1]:12225/local/switch-id)
1522026-09-08T19:41:05.288ZWARNslog-rs (mg-lower): failed to ensure TEP address fdaa:84ee:34d2:e013::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) error = Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6) module = sync prefix = fdaa:84ee:34d2:e013::1 unit = dpd
153 [ Sep 8 19:41:06 Rereading configuration. ]
1542026-09-08T19:41:06.746ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:59660 unit = api_server
1552026-09-08T19:41:06.747ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59660 req_id = 6ba5833e-22fa-410a-bbdd-776542d6dcda unit = api_server uri = /static/route4 version = 12.0.0
1562026-09-08T19:41:06.747ZINFOslog-rs (mgd): request completed latency_us = 308 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59660 req_id = 6ba5833e-22fa-410a-bbdd-776542d6dcda response_code = 200 unit = api_server uri = /static/route4
1572026-09-08T19:41:06.747ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59660 req_id = acb78d83-9630-4660-917a-9deabd7d37b1 unit = api_server uri = /static/route6 version = 12.0.0
1582026-09-08T19:41:06.747ZINFOslog-rs (mgd): request completed latency_us = 138 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59660 req_id = acb78d83-9630-4660-917a-9deabd7d37b1 response_code = 200 unit = api_server uri = /static/route6
159 [ Sep 8 19:41:06 Executing refresh method ("/opt/oxide/mgd/pkg/refresh_ctrun_child.sh -c 211"). ]
1602026-09-08T19:41:06.754ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = PUT module = admin remote_addr = [fd00:1122:3344:101::1]:59660 req_id = a163bd65-1289-42c8-827a-bf7178b027f2 unit = api_server uri = /static/route4 version = 12.0.0
1612026-09-08T19:41:06.754ZINFOslog-rs (mgd): request completed latency_us = 578 local_addr = [::]:4676 method = PUT module = admin remote_addr = [fd00:1122:3344:101::1]:59660 req_id = a163bd65-1289-42c8-827a-bf7178b027f2 response_code = 204 unit = api_server uri = /static/route4
1622026-09-08T19:41:06.754ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59660 req_id = 04978bb4-77e6-4625-b0b2-887f026bd5f2 unit = api_server uri = /bgp/config/routers version = 12.0.0
1632026-09-08T19:41:06.754ZINFOslog-rs (mgd): request completed latency_us = 79 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59660 req_id = 04978bb4-77e6-4625-b0b2-887f026bd5f2 response_code = 200 unit = api_server uri = /bgp/config/routers
1642026-09-08T19:41:06.755ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59660 req_id = a0a73d84-4b1f-4120-8c2b-3b323209807a unit = api_server uri = /bfd/peers version = 12.0.0
1652026-09-08T19:41:06.755ZINFOslog-rs (mgd): request completed latency_us = 175 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:59660 req_id = a0a73d84-4b1f-4120-8c2b-3b323209807a response_code = 200 unit = api_server uri = /bfd/peers
166 + CONTRACT=''
167 + getopts c: o
168 + CONTRACT=211
169 + getopts c: o
170 + [[ -n 211 ]]
171 + pgrep -c 211
1722026-09-08T19:41:06.756ZERROslog-rs (mg-lower): handling change failed: route lookup error io error No such process (os error 3) error = route lookup error io error No such process (os error 3) module = sync unit = event_loop
1732026-09-08T19:41:06.756ZINFOslog-rs (mg-lower): restarting sync loop module = sync unit = event_loop
174 + PARENT_PID=2285
175 + [[ -n 2285 ]]
176 + pgrep -P 2285
177 + CHILD_PID=2286
178 + [[ -n 2286 ]]
179 + kill -USR1 2286
1802026-09-08T19:41:06.759ZINFOslog-rs (mgd): handling smf refresh module = admin unit = smf
1812026-09-08T19:41:06.761ZINFOslog-rs (mgd): starting stats server on smf refresh module = admin unit = smf
1822026-09-08T19:41:06.761ZINFOslog-rs (mgd): started stats server on smf refresh module = admin unit = smf
183 [ Sep 8 19:41:06 Method "refresh" exited with status 0. ]
184 Sep 08 19:41:06.762 DEBG registered DTrace probes
185 Sep 08 19:41:06.762 DEBG registered endpoint, versions: all, path: /{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot
186 Sep 08 19:41:06.762 INFO listening, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.17.1/src/server.rs:335
187 Sep 08 19:41:06.762 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot
188 Sep 08 19:41:06.762 DEBG Nexus IP not provided, will use DNS to resolve it
189 Sep 08 19:41:06.762 INFO new DNS resolver, addresses: [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53], component: internal-dns-resolver, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/internal-dns/resolver/src/resolver.rs:144
190 Sep 08 19:41:06.763 DEBG starting producer registration task
191 Sep 08 19:41:06.763 INFO starting oximeter metric producer server, interval: 1s, address: [fd00:1122:3344:101::2]:4677, producer_id: 398420d2-e762-4994-827b-24c542991596, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:280
192 Sep 08 19:41:06.763 DEBG registering as oximeter producer with Nexus, registration_count: 0, component: producer-registration-task
193 Sep 08 19:41:11.766 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3eab3151-6b65-44a9-b641-b5ee25ce12b7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6336f4ee-c81d-4cf4-83a4-39f620fc1787.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("79f38a9c-eccf-4855-99e4-f3749ce1b8bf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("79f38a9c-eccf-4855-99e4-f3749ce1b8bf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 2037, tv_nsec: 211870779 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
194 Sep 08 19:41:11.766 DEBG will register with Nexus at [fd00:1122:3344:101::a]:12221, component: producer-registration-task
195 Sep 08 19:41:11.767 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
1962026-09-08T19:41:15.271ZDEBGslog-rs: client request body = None method = GET unit = gateway-client uri = http://[::1]:12225/local/switch-id
1972026-09-08T19:41:15.272ZDEBGslog-rs: client response result = Ok(Response { url: "http://[::1]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "10c3c26a-5941-4ec7-b159-efaeb9ee6778", "content-length": "26", "date": "Tue, 08 Sep 2026 19:41:15 GMT"} }) unit = gateway-client
1982026-09-08T19:41:15.272ZINFOslog-rs: we are in switch slot 0
199 Sep 08 19:41:27.348 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
200 Sep 08 19:41:27.348 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out, delay: 20.005201541s, count: 0, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
201 Sep 08 19:41:27.720 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3eab3151-6b65-44a9-b641-b5ee25ce12b7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6336f4ee-c81d-4cf4-83a4-39f620fc1787.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("79f38a9c-eccf-4855-99e4-f3749ce1b8bf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("79f38a9c-eccf-4855-99e4-f3749ce1b8bf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 2052, tv_nsec: 586925628 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
202 Sep 08 19:41:27.721 DEBG will register with Nexus at [fd00:1122:3344:101::a]:12221, component: producer-registration-task
203 Sep 08 19:41:27.721 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
2042026-09-08T19:41:37.309ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:49588 unit = api_server
2052026-09-08T19:41:37.309ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:49588 req_id = 88eb489a-7653-4d85-be01-03a773595417 unit = api_server uri = /static/route4 version = 12.0.0
2062026-09-08T19:41:37.309ZINFOslog-rs (mgd): request completed latency_us = 134 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:49588 req_id = 88eb489a-7653-4d85-be01-03a773595417 response_code = 200 unit = api_server uri = /static/route4
2072026-09-08T19:41:37.309ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:49588 req_id = 1f045e84-d9e8-49b0-9274-33b8a3feb1be unit = api_server uri = /static/route6 version = 12.0.0
2082026-09-08T19:41:37.309ZINFOslog-rs (mgd): request completed latency_us = 66 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:49588 req_id = 1f045e84-d9e8-49b0-9274-33b8a3feb1be response_code = 200 unit = api_server uri = /static/route6
2092026-09-08T19:41:37.310ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:49588 req_id = 3a675442-c6a0-4352-9e2f-2b7511e8d126 unit = api_server uri = /bgp/config/routers version = 12.0.0
2102026-09-08T19:41:37.310ZINFOslog-rs (mgd): request completed latency_us = 30 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:49588 req_id = 3a675442-c6a0-4352-9e2f-2b7511e8d126 response_code = 200 unit = api_server uri = /bgp/config/routers
2112026-09-08T19:41:37.310ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:49588 req_id = 778baa4b-e80a-4e69-9d2f-63827e1e1631 unit = api_server uri = /bfd/peers version = 12.0.0
2122026-09-08T19:41:37.310ZINFOslog-rs (mgd): request completed latency_us = 43 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:49588 req_id = 778baa4b-e80a-4e69-9d2f-63827e1e1631 response_code = 200 unit = api_server uri = /bfd/peers
213 Sep 08 19:41:42.681 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
214 Sep 08 19:41:42.681 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out, delay: 35.380480095s, count: 1, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
215 Sep 08 19:41:43.392 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3eab3151-6b65-44a9-b641-b5ee25ce12b7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6336f4ee-c81d-4cf4-83a4-39f620fc1787.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("79f38a9c-eccf-4855-99e4-f3749ce1b8bf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("79f38a9c-eccf-4855-99e4-f3749ce1b8bf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 2068, tv_nsec: 302755091 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
216 Sep 08 19:41:43.393 DEBG will register with Nexus at [fd00:1122:3344:101::a]:12221, component: producer-registration-task
217 Sep 08 19:41:43.394 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
218 Sep 08 19:41:58.355 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
219 Sep 08 19:41:58.355 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out, delay: 51.096320408s, count: 2, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
220 Sep 08 19:41:59.071 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3eab3151-6b65-44a9-b641-b5ee25ce12b7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6336f4ee-c81d-4cf4-83a4-39f620fc1787.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("79f38a9c-eccf-4855-99e4-f3749ce1b8bf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("79f38a9c-eccf-4855-99e4-f3749ce1b8bf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 2084, tv_nsec: 23420095 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
221 Sep 08 19:41:59.072 DEBG will register with Nexus at [fd00:1122:3344:101::a]:12221, component: producer-registration-task
222 Sep 08 19:41:59.072 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
2232026-09-08T19:42:07.231ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:61884 unit = api_server
2242026-09-08T19:42:07.231ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:61884 req_id = 592f2872-899c-409b-a1f3-74c759b592cc unit = api_server uri = /static/route4 version = 12.0.0
2252026-09-08T19:42:07.231ZINFOslog-rs (mgd): request completed latency_us = 113 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:61884 req_id = 592f2872-899c-409b-a1f3-74c759b592cc response_code = 200 unit = api_server uri = /static/route4
2262026-09-08T19:42:07.231ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:61884 req_id = 8a1eb75f-dda5-4519-9a38-f409fa94ef4b unit = api_server uri = /static/route6 version = 12.0.0
2272026-09-08T19:42:07.231ZINFOslog-rs (mgd): request completed latency_us = 79 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:61884 req_id = 8a1eb75f-dda5-4519-9a38-f409fa94ef4b response_code = 200 unit = api_server uri = /static/route6
2282026-09-08T19:42:07.232ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:61884 req_id = 8cd4c4c2-3ba5-4643-9796-477fd83e062f unit = api_server uri = /bgp/config/routers version = 12.0.0
2292026-09-08T19:42:07.232ZINFOslog-rs (mgd): request completed latency_us = 49 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:61884 req_id = 8cd4c4c2-3ba5-4643-9796-477fd83e062f response_code = 200 unit = api_server uri = /bgp/config/routers
2302026-09-08T19:42:07.232ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:61884 req_id = 4b600059-1983-49b0-8c95-e582c3fb44ad unit = api_server uri = /bfd/peers version = 12.0.0
2312026-09-08T19:42:07.232ZINFOslog-rs (mgd): request completed latency_us = 28 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:61884 req_id = 4b600059-1983-49b0-8c95-e582c3fb44ad response_code = 200 unit = api_server uri = /bfd/peers
232 Sep 08 19:42:14.033 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
233 Sep 08 19:42:14.033 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out, delay: 66.817047684s, count: 3, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
234 Sep 08 19:42:16.260 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3eab3151-6b65-44a9-b641-b5ee25ce12b7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6336f4ee-c81d-4cf4-83a4-39f620fc1787.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("79f38a9c-eccf-4855-99e4-f3749ce1b8bf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("79f38a9c-eccf-4855-99e4-f3749ce1b8bf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 2101, tv_nsec: 259330164 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
235 Sep 08 19:42:16.261 DEBG will register with Nexus at [fd00:1122:3344:101::a]:12221, component: producer-registration-task
236 Sep 08 19:42:16.262 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
237 Sep 08 19:42:31.222 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
238 Sep 08 19:42:31.223 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out, delay: 84.052896391s, count: 4, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
239 Sep 08 19:42:36.304 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3eab3151-6b65-44a9-b641-b5ee25ce12b7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6336f4ee-c81d-4cf4-83a4-39f620fc1787.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("79f38a9c-eccf-4855-99e4-f3749ce1b8bf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("79f38a9c-eccf-4855-99e4-f3749ce1b8bf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 2121, tv_nsec: 357207933 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
240 Sep 08 19:42:36.304 DEBG will register with Nexus at [fd00:1122:3344:101::a]:12221, component: producer-registration-task
241 Sep 08 19:42:36.305 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
2422026-09-08T19:42:37.152ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:64834 unit = api_server
2432026-09-08T19:42:37.153ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:64834 req_id = e17e6206-38b7-42f0-b1c9-d6dce48d9561 unit = api_server uri = /static/route4 version = 12.0.0
2442026-09-08T19:42:37.153ZINFOslog-rs (mgd): request completed latency_us = 95 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:64834 req_id = e17e6206-38b7-42f0-b1c9-d6dce48d9561 response_code = 200 unit = api_server uri = /static/route4
2452026-09-08T19:42:37.153ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:64834 req_id = 7bb6423b-6f99-4e5b-afd1-9138d7e2fc2f unit = api_server uri = /static/route6 version = 12.0.0
2462026-09-08T19:42:37.153ZINFOslog-rs (mgd): request completed latency_us = 91 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:64834 req_id = 7bb6423b-6f99-4e5b-afd1-9138d7e2fc2f response_code = 200 unit = api_server uri = /static/route6
2472026-09-08T19:42:37.153ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:64834 req_id = 1376a31d-bfbe-4206-bd6e-ce5e2deafb7d unit = api_server uri = /bgp/config/routers version = 12.0.0
2482026-09-08T19:42:37.153ZINFOslog-rs (mgd): request completed latency_us = 59 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:64834 req_id = 1376a31d-bfbe-4206-bd6e-ce5e2deafb7d response_code = 200 unit = api_server uri = /bgp/config/routers
2492026-09-08T19:42:37.154ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:64834 req_id = c6b83f87-e63a-4ca2-8bb2-e16bba054dbb unit = api_server uri = /bfd/peers version = 12.0.0
2502026-09-08T19:42:37.154ZINFOslog-rs (mgd): request completed latency_us = 33 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:64834 req_id = c6b83f87-e63a-4ca2-8bb2-e16bba054dbb response_code = 200 unit = api_server uri = /bfd/peers
251 Sep 08 19:42:51.266 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
252 Sep 08 19:42:51.266 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out, delay: 104.15077833s, count: 5, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
253 Sep 08 19:43:01.204 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3eab3151-6b65-44a9-b641-b5ee25ce12b7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6336f4ee-c81d-4cf4-83a4-39f620fc1787.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("79f38a9c-eccf-4855-99e4-f3749ce1b8bf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("79f38a9c-eccf-4855-99e4-f3749ce1b8bf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 2146, tv_nsec: 324694177 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
254 Sep 08 19:43:01.204 DEBG will register with Nexus at [fd00:1122:3344:101::a]:12221, component: producer-registration-task
255 Sep 08 19:43:01.205 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
2562026-09-08T19:43:07.074ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:56693 unit = api_server
2572026-09-08T19:43:07.074ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56693 req_id = fefd4406-0d15-42cb-b8f5-02057fdd14cd unit = api_server uri = /static/route4 version = 12.0.0
2582026-09-08T19:43:07.074ZINFOslog-rs (mgd): request completed latency_us = 140 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56693 req_id = fefd4406-0d15-42cb-b8f5-02057fdd14cd response_code = 200 unit = api_server uri = /static/route4
2592026-09-08T19:43:07.074ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56693 req_id = e2b2eab6-8f00-44bc-b9cf-abee230a68d0 unit = api_server uri = /static/route6 version = 12.0.0
2602026-09-08T19:43:07.074ZINFOslog-rs (mgd): request completed latency_us = 95 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56693 req_id = e2b2eab6-8f00-44bc-b9cf-abee230a68d0 response_code = 200 unit = api_server uri = /static/route6
2612026-09-08T19:43:07.074ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56693 req_id = 3b7559c5-c187-4804-9552-c29555b96f50 unit = api_server uri = /bgp/config/routers version = 12.0.0
2622026-09-08T19:43:07.075ZINFOslog-rs (mgd): request completed latency_us = 45 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56693 req_id = 3b7559c5-c187-4804-9552-c29555b96f50 response_code = 200 unit = api_server uri = /bgp/config/routers
2632026-09-08T19:43:07.075ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56693 req_id = 65efeaed-3370-4466-befa-14148ea73e2e unit = api_server uri = /bfd/peers version = 12.0.0
2642026-09-08T19:43:07.075ZINFOslog-rs (mgd): request completed latency_us = 35 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:56693 req_id = 65efeaed-3370-4466-befa-14148ea73e2e response_code = 200 unit = api_server uri = /bfd/peers
265 Sep 08 19:43:16.166 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
266 Sep 08 19:43:16.166 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out, delay: 129.118533361s, count: 6, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
267 Sep 08 19:43:35.339 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3eab3151-6b65-44a9-b641-b5ee25ce12b7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6336f4ee-c81d-4cf4-83a4-39f620fc1787.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("79f38a9c-eccf-4855-99e4-f3749ce1b8bf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("79f38a9c-eccf-4855-99e4-f3749ce1b8bf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 2180, tv_nsec: 552237498 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
268 Sep 08 19:43:35.340 DEBG will register with Nexus at [fd00:1122:3344:101::a]:12221, component: producer-registration-task
269 Sep 08 19:43:35.340 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
2702026-09-08T19:43:36.996ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:42465 unit = api_server
2712026-09-08T19:43:36.996ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:42465 req_id = 6c2ec5d6-fb99-4aa6-8a43-4013326e1a25 unit = api_server uri = /static/route4 version = 12.0.0
2722026-09-08T19:43:36.996ZINFOslog-rs (mgd): request completed latency_us = 87 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:42465 req_id = 6c2ec5d6-fb99-4aa6-8a43-4013326e1a25 response_code = 200 unit = api_server uri = /static/route4
2732026-09-08T19:43:36.996ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:42465 req_id = 2f11d88c-61c6-4096-9733-1559dac3e1ee unit = api_server uri = /static/route6 version = 12.0.0
2742026-09-08T19:43:36.996ZINFOslog-rs (mgd): request completed latency_us = 70 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:42465 req_id = 2f11d88c-61c6-4096-9733-1559dac3e1ee response_code = 200 unit = api_server uri = /static/route6
2752026-09-08T19:43:36.996ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:42465 req_id = b5811193-03c3-40e9-9c87-c89daa4a585f unit = api_server uri = /bgp/config/routers version = 12.0.0
2762026-09-08T19:43:36.996ZINFOslog-rs (mgd): request completed latency_us = 44 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:42465 req_id = b5811193-03c3-40e9-9c87-c89daa4a585f response_code = 200 unit = api_server uri = /bgp/config/routers
2772026-09-08T19:43:36.996ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:42465 req_id = 17ad41fe-93f2-48aa-87ba-93b3da6d10a6 unit = api_server uri = /bfd/peers version = 12.0.0
2782026-09-08T19:43:36.997ZINFOslog-rs (mgd): request completed latency_us = 32 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:42465 req_id = 17ad41fe-93f2-48aa-87ba-93b3da6d10a6 response_code = 200 unit = api_server uri = /bfd/peers
279 Sep 08 19:43:50.302 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
280 Sep 08 19:43:50.302 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out, delay: 163.346396198s, count: 7, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
2812026-09-08T19:44:06.931ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:36459 unit = api_server
2822026-09-08T19:44:06.931ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:36459 req_id = 2e2f57cc-d8e2-47cd-8a8f-5bfc51a9e6cc unit = api_server uri = /static/route4 version = 12.0.0
2832026-09-08T19:44:06.931ZINFOslog-rs (mgd): request completed latency_us = 93 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:36459 req_id = 2e2f57cc-d8e2-47cd-8a8f-5bfc51a9e6cc response_code = 200 unit = api_server uri = /static/route4
2842026-09-08T19:44:06.931ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:36459 req_id = ad1849b7-9ded-4f2e-a9d1-9d1a01a79887 unit = api_server uri = /static/route6 version = 12.0.0
2852026-09-08T19:44:06.931ZINFOslog-rs (mgd): request completed latency_us = 54 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:36459 req_id = ad1849b7-9ded-4f2e-a9d1-9d1a01a79887 response_code = 200 unit = api_server uri = /static/route6
2862026-09-08T19:44:06.931ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:36459 req_id = 599b505f-64d8-4c56-810b-09820ee7ed2f unit = api_server uri = /bgp/config/routers version = 12.0.0
2872026-09-08T19:44:06.932ZINFOslog-rs (mgd): request completed latency_us = 37 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:36459 req_id = 599b505f-64d8-4c56-810b-09820ee7ed2f response_code = 200 unit = api_server uri = /bgp/config/routers
2882026-09-08T19:44:06.932ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:36459 req_id = 60522697-0f05-478a-afd0-8bb6ed5fcd7c unit = api_server uri = /bfd/peers version = 12.0.0
2892026-09-08T19:44:06.932ZINFOslog-rs (mgd): request completed latency_us = 21 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:36459 req_id = 60522697-0f05-478a-afd0-8bb6ed5fcd7c response_code = 200 unit = api_server uri = /bfd/peers
290 Sep 08 19:44:20.097 DEBG lookup_socket_v6 srv, response: SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3eab3151-6b65-44a9-b641-b5ee25ce12b7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("6336f4ee-c81d-4cf4-83a4-39f620fc1787.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("79f38a9c-eccf-4855-99e4-f3749ce1b8bf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("79f38a9c-eccf-4855-99e4-f3749ce1b8bf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 2225, tv_nsec: 381637886 } }), dns_name: _nexus._tcp.control-plane.oxide.internal, component: internal-dns-resolver
291 Sep 08 19:44:20.098 DEBG will register with Nexus at [fd00:1122:3344:101::a]:12221, component: producer-registration-task
292 Sep 08 19:44:20.099 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
293 Sep 08 19:44:35.100 DEBG client response, result: Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }), component: producer-registration-task
294 Sep 08 19:44:35.100 WARN failed to register with Nexus, will retry, error: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out, delay: 208.17505313s, count: 8, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/d6fba55/oximeter/producer/src/lib.rs:376
2952026-09-08T19:44:36.933ZINFOslog-rs (mgd): accepted connection local_addr = [::]:4676 module = admin remote_addr = [fd00:1122:3344:101::1]:50691 unit = api_server
2962026-09-08T19:44:36.933ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:50691 req_id = f0225137-10e7-4475-bb3e-4f46ee81a1f0 unit = api_server uri = /static/route4 version = 12.0.0
2972026-09-08T19:44:36.933ZINFOslog-rs (mgd): request completed latency_us = 69 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:50691 req_id = f0225137-10e7-4475-bb3e-4f46ee81a1f0 response_code = 200 unit = api_server uri = /static/route4
2982026-09-08T19:44:36.933ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:50691 req_id = 92ab4c74-e1c4-4290-9626-bebe7353093c unit = api_server uri = /static/route6 version = 12.0.0
2992026-09-08T19:44:36.933ZINFOslog-rs (mgd): request completed latency_us = 31 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:50691 req_id = 92ab4c74-e1c4-4290-9626-bebe7353093c response_code = 200 unit = api_server uri = /static/route6
3002026-09-08T19:44:36.933ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:50691 req_id = d02082bc-dbc2-45fe-aa9f-34255066fa58 unit = api_server uri = /bgp/config/routers version = 12.0.0
3012026-09-08T19:44:36.933ZINFOslog-rs (mgd): request completed latency_us = 26 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:50691 req_id = d02082bc-dbc2-45fe-aa9f-34255066fa58 response_code = 200 unit = api_server uri = /bgp/config/routers
3022026-09-08T19:44:36.933ZDEBGslog-rs (mgd): determined request API version local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:50691 req_id = d9988255-52ed-4fb0-8b0c-889de58d2fea unit = api_server uri = /bfd/peers version = 12.0.0
3032026-09-08T19:44:36.933ZINFOslog-rs (mgd): request completed latency_us = 20 local_addr = [::]:4676 method = GET module = admin remote_addr = [fd00:1122:3344:101::1]:50691 req_id = d9988255-52ed-4fb0-8b0c-889de58d2fea response_code = 200 unit = api_server uri = /bfd/peers