Max level shown:
1 [ Sep 27 04:14:46 Disabled. ]
2 [ Sep 27 04:14:46 Rereading configuration. ]
3 [ Sep 27 04:14:46 Enabled. ]
4 [ Sep 27 04:14:46 Rereading configuration. ]
5 [ Sep 27 04:14:46 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/mgd/pkg/mgd_method_script.sh &"). ]
6 [ Sep 27 04:14:46 Method "start" exited with status 0. ]
72024-09-27T04:14:46.830ZINFOslog-rs: signal handler waiting for context
82024-09-27T04:14:46.852ZINFOslog-rs: signal handler waiting got context
92024-09-27T04:14:46.853ZINFOslog-rs: bgp routers: {}
102024-09-27T04:14:46.853ZINFOslog-rs: bfd peers: []
112024-09-27T04:14:46.853ZERROslog-rs: failed to start stats server: underlay address not found
122024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bfd/peers unit = api-server
132024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = PUT path = /bfd/peers unit = api-server
142024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = DELETE path = /bfd/peers/{addr} unit = api-server
152024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = DELETE path = /bgp/config/checker unit = api-server
162024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/config/checker unit = api-server
172024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = POST path = /bgp/config/checker unit = api-server
182024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = PUT path = /bgp/config/checker unit = api-server
192024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = DELETE path = /bgp/config/neighbor unit = api-server
202024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/config/neighbor unit = api-server
212024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = POST path = /bgp/config/neighbor unit = api-server
222024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = PUT path = /bgp/config/neighbor unit = api-server
232024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/config/neighbors unit = api-server
242024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = DELETE path = /bgp/config/origin4 unit = api-server
252024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/config/origin4 unit = api-server
262024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = POST path = /bgp/config/origin4 unit = api-server
272024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = PUT path = /bgp/config/origin4 unit = api-server
282024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = DELETE path = /bgp/config/router unit = api-server
292024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/config/router unit = api-server
302024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = POST path = /bgp/config/router unit = api-server
312024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = PUT path = /bgp/config/router unit = api-server
322024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/config/routers unit = api-server
332024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = DELETE path = /bgp/config/shaper unit = api-server
342024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/config/shaper unit = api-server
352024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = POST path = /bgp/config/shaper unit = api-server
362024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = PUT path = /bgp/config/shaper unit = api-server
372024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/message-history unit = api-server
382024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = POST path = /bgp/omicron/apply unit = api-server
392024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/status/exported unit = api-server
402024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/status/imported unit = api-server
412024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/status/neighbors unit = api-server
422024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /bgp/status/selected unit = api-server
432024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = DELETE path = /static/route4 unit = api-server
442024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = GET path = /static/route4 unit = api-server
452024-09-27T04:14:46.857ZDEBGslog-rs: registered endpoint local_addr = [::]:4676 method = PUT path = /static/route4 unit = api-server
462024-09-27T04:14:46.857ZINFOslog-rs: admin: listening on [::]:4676
472024-09-27T04:14:46.857ZINFOslog-rs: listening local_addr = [::]:4676 unit = api-server
482024-09-27T04:14:46.859ZDEBGslog-rs: successfully registered DTrace USDT probes local_addr = [::]:4676 unit = api-server
492024-09-27T04:14:46.928ZWARNslog-rs: failed to ensure TEP address fd13:bd7f:bcfb:eb53::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6): error trying to connect: tcp connect error: Connection refused (os error 146)
502024-09-27T04:14:47.929ZWARNslog-rs: failed to ensure TEP address fd13:bd7f:bcfb:eb53::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6): error trying to connect: tcp connect error: Connection refused (os error 146)
512024-09-27T04:14:48.930ZWARNslog-rs: failed to ensure TEP address fd13:bd7f:bcfb:eb53::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6): error trying to connect: tcp connect error: Connection refused (os error 146)
522024-09-27T04:14:49.931ZWARNslog-rs: failed to ensure TEP address fd13:bd7f:bcfb:eb53::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6): error trying to connect: tcp connect error: Connection refused (os error 146)
532024-09-27T04:14:50.931ZWARNslog-rs: failed to ensure TEP address fd13:bd7f:bcfb:eb53::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6): error trying to connect: tcp connect error: Connection refused (os error 146)
542024-09-27T04:14:51.932ZWARNslog-rs: failed to ensure TEP address fd13:bd7f:bcfb:eb53::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6): error trying to connect: tcp connect error: Connection refused (os error 146)
552024-09-27T04:14:52.932ZWARNslog-rs: failed to ensure TEP address fd13:bd7f:bcfb:eb53::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6): error trying to connect: tcp connect error: Connection refused (os error 146)
562024-09-27T04:14:53.933ZWARNslog-rs: failed to ensure TEP address fd13:bd7f:bcfb:eb53::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6): error trying to connect: tcp connect error: Connection refused (os error 146)
572024-09-27T04:14:54.933ZWARNslog-rs: failed to ensure TEP address fd13:bd7f:bcfb:eb53::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6): error trying to connect: tcp connect error: Connection refused (os error 146)
582024-09-27T04:14:55.934ZWARNslog-rs: failed to ensure TEP address fd13:bd7f:bcfb:eb53::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6): error trying to connect: tcp connect error: Connection refused (os error 146)
592024-09-27T04:14:56.935ZWARNslog-rs: failed to ensure TEP address fd13:bd7f:bcfb:eb53::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6): error trying to connect: tcp connect error: Connection refused (os error 146)
602024-09-27T04:14:57.935ZWARNslog-rs: failed to ensure TEP address fd13:bd7f:bcfb:eb53::1 on ASIC: Communication Error: error sending request for url (http://localhost:12224/loopback/ipv6): error trying to connect: tcp connect error: Connection refused (os error 146)
61 [ Sep 27 04:14:58 Rereading configuration. ]
62 [ Sep 27 04:14:58 Executing refresh method ("/opt/oxide/mgd/pkg/refresh_ctrun_child.sh -c 214"). ]
63 + CONTRACT=''
64 + getopts c: o
65 + CONTRACT=214
66 + getopts c: o
67 + [[ -n 214 ]]
68 + pgrep -c 214
69 + PARENT_PID=2273
70 + [[ -n 2273 ]]
71 + pgrep -P 2273
72 + CHILD_PID=2275
73 + [[ -n 2275 ]]
74 + kill -USR1 2275
752024-09-27T04:14:58.105ZINFOslog-rs: handling smf refresh
762024-09-27T04:14:58.107ZINFOslog-rs: starting stats server on smf refresh
77 [ Sep 27 04:14:58 Method "refresh" exited with status 0. ]
78 Sep 27 04:14:58.108 DEBG registered DTrace probes
79 Sep 27 04:14:58.108 DEBG registered endpoint, path: /{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot
80 Sep 27 04:14:58.108 INFO listening, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205
81 Sep 27 04:14:58.109 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:4677, component: dropshot
82 Sep 27 04:14:58.109 DEBG Nexus IP not provided, will use DNS to resolve it
83 Sep 27 04:14:58.109 INFO new DNS resolver, addresses: [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53], component: internal-dns-resolver, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/66ac7b3/internal-dns/src/resolver.rs:73
84 Sep 27 04:14:58.109 DEBG starting producer registration task
85 Sep 27 04:14:58.109 INFO starting oximeter metric producer server, interval: 1s, address: [fd00:1122:3344:101::2]:4677, producer_id: e9ec1087-6935-47e0-82d3-73a93568b388, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/66ac7b3/oximeter/producer/src/lib.rs:283
86 Sep 27 04:14:58.109 DEBG registering / renewing oximeter producer lease with Nexus, component: producer-registration-task
872024-09-27T04:14:58.294ZINFOslog-rs: accepted connection local_addr = [::]:4676 remote_addr = [fd00:1122:3344:101::1]:46353 unit = api-server
882024-09-27T04:14:58.295ZINFOslog-rs: request completed latency_us = 417 local_addr = [::]:4676 method = PUT remote_addr = [fd00:1122:3344:101::1]:46353 req_id = 57b2232f-0627-4b07-bf5c-70bcbbd0d2c0 response_code = 204 unit = api-server uri = /static/route4
892024-09-27T04:14:58.295ZERROslog-rs: handling change failed: libnet error route io error No such process (os error 3)
902024-09-27T04:14:58.295ZINFOslog-rs: restarting sync loop