Max level shown:
1 [ Mar 30 05:42:23 Disabled. ]
2 [ Mar 30 05:42:23 Rereading configuration. ]
3 [ Mar 30 05:42:36 Rereading configuration. ]
4 [ Mar 30 05:42:37 Rereading configuration. ]
5 [ Mar 30 05:42:37 Enabled. ]
6 [ Mar 30 05:42:37 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/mg-ddm/pkg/ddm_method_script.sh &"). ]
7 [ Mar 30 05:42:37 Method "start" exited with status 0. ]
82024-03-30T05:42:37.089ZINFOslog-rs: signal handler waiting for context
92024-03-30T05:42:37.113ZINFOslog-rs: signal handler waiting got context
102024-03-30T05:42:37.114ZINFOslog-rs: [tfportrear0_0] sm initialized with addr fe80::dc3f:61ff:fe81:82ee on if tfportrear0_0 index 3
112024-03-30T05:42:37.114ZDEBGslog-rs: [tfportrear0_0] starting discovery handler
122024-03-30T05:42:37.114ZINFOslog-rs: admin: listening on [::1]:8000
13 [ Mar 30 05:42:38 Rereading configuration. ]
14 [ Mar 30 05:42:38 Executing refresh method ("/opt/oxide/mg-ddm/pkg/refresh_ctrun_child.sh -c 438"). ]
15 + CONTRACT=''
16 + getopts c: o
17 + CONTRACT=438
18 + getopts c: o
19 + [[ -n 438 ]]
20 + pgrep -c 438
21 + PARENT_PID=3995
22 + [[ -n 3995 ]]
23 + pgrep -P 3995
24 + CHILD_PID=3996
25 + [[ -n 3996 ]]
26 + kill -USR1 3996
272024-03-30T05:42:38.363ZINFOslog-rs: handling smf refresh
28 [ Mar 30 05:42:38 Method "refresh" exited with status 0. ]
292024-03-30T05:42:38.365ZINFOslog-rs: starting stats server on smf refresh
302024-03-30T05:42:38.365ZINFOslog-rs: resolving nexus
312024-03-30T05:42:38.365ZINFOslog-rs: new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53]
322024-03-30T05:42:38.440ZWARNslog-rs: [tfportrear0_0] admin event in solicit state: Announce(Underlay({Ipv6Prefix { addr: fdcc:3062:2a73:db69::1, len: 64 }}))
332024-03-30T05:42:38.440ZINFOslog-rs: advertise tunnel: { TunnelOrigin { overlay_prefix: V4( Ipv4Prefix { addr: 0.0.0.0, len: 0, }, ), boundary_addr: fdcc:3062:2a73:db69::1, vni: 99, metric: 100, }, }
342024-03-30T05:42:38.440ZWARNslog-rs: [tfportrear0_0] admin event in solicit state: Announce(Tunnel({TunnelOrigin { overlay_prefix: V4(Ipv4Prefix { addr: 0.0.0.0, len: 0 }), boundary_addr: fdcc:3062:2a73:db69::1, vni: 99, metric: 100 }}))
352024-03-30T05:42:39.114ZINFOslog-rs: [tfportrear0_0] nbr is fe80::6c80:a6ff:fe61:6ed7@buskin server
362024-03-30T05:42:39.114ZDEBGslog-rs: [tfportrear0_0] transition solicit -> exchange
372024-03-30T05:42:39.115ZINFOslog-rs: [tfportrear0_0] exchange: listening on [fe80::dc3f:61ff:fe81:82ee]:56797
382024-03-30T05:42:39.115ZINFOslog-rs: [tfportrear0_0] waiting for exchange server to start
392024-03-30T05:42:39.117ZINFOslog-rs: [tfportrear0_0] sending 5 routes to dendrite
402024-03-30T05:42:39.117ZDEBGslog-rs: [tfportrear0_0] sending to dpd host=localhost port=12224
412024-03-30T05:42:39.155ZINFOslog-rs: [tfportrear0_0] adding route fdb0:18c0:4d0d:9fb2:: -> fe80::6c80:a6ff:fe61:6ed7 on port Rear(RearPort(0))/0
422024-03-30T05:42:39.156ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:1:: -> fe80::6c80:a6ff:fe61:6ed7 on port Rear(RearPort(0))/0
432024-03-30T05:42:39.156ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:2:: -> fe80::6c80:a6ff:fe61:6ed7 on port Rear(RearPort(0))/0
442024-03-30T05:42:39.156ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:3:: -> fe80::6c80:a6ff:fe61:6ed7 on port Rear(RearPort(0))/0
452024-03-30T05:42:39.156ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:101:: -> fe80::6c80:a6ff:fe61:6ed7 on port Rear(RearPort(0))/0
462024-03-30T05:42:39.157ZINFOslog-rs: [tfportrear0_0] removing routes 0 from dendrite
472024-03-30T05:42:39.186ZDEBGslog-rs: [tfportrear0_0] redistributing update to 0 peers
482024-03-30T05:42:43.370ZDEBGslog-rs: lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("3b85f16b-9ecd-4867-ae56-7f8a1f492a4d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("cca30d41-f76f-4c5a-92f4-bb1cde1c17bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f33d72e6-7ea4-4e54-8bfc-dc4233c612c4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f33d72e6-7ea4-4e54-8bfc-dc4233c612c4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 997, tv_nsec: 804998956 } })
49 Mar 30 05:42:43.371 DEBG registered DTrace probes
50 Mar 30 05:42:43.371 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
51 Mar 30 05:42:43.371 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
52 Mar 30 05:42:43.371 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
53 Mar 30 05:42:43.371 DEBG registering metric server as a producer
54 Mar 30 05:42:43.401 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::b]:12221/metrics/producers, method: POST
55 Mar 30 05:42:58.402 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
56 Mar 30 05:42:58.403 INFO received request to begin graceful shutdown, local_addr: [fd00:1122{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out waiting 124.293649ms","v":0,"name":"slog-rs","level":40,"time":"2024-03-30T05:42:58.403995537Z","hostname":"oxz_switch","pid":3996}
57 :3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
58 Mar 30 05:42:58.529 DEBG registered DTrace probes
59 Mar 30 05:42:58.529 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
60 Mar 30 05:42:58.529 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
61 Mar 30 05:42:58.529 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
62 Mar 30 05:42:58.529 DEBG registering metric server as a producer
63 Mar 30 05:42:58.558 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::b]:12221/metrics/producers, method: POST
64 Mar 30 05:43:14.248 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
65 Mar 30 05:43:14.249 INFO received request to begin graceful shutdown, local_addr: [fd00:1122{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out waiting 100.62414ms","v":0,"name":"slog-rs","level":40,"time":"2024-03-30T05:43:14.249434592Z","hostname":"oxz_switch","pid":3996}
66 :3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
67 Mar 30 05:43:14.350 DEBG registered DTrace probes
68 Mar 30 05:43:14.350 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
69 Mar 30 05:43:14.350 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
70 Mar 30 05:43:14.350 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
71 Mar 30 05:43:14.351 DEBG registering metric server as a producer
72 Mar 30 05:43:14.379 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::b]:12221/metrics/producers, method: POST
732024-03-30T05:43:29.898ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::6c80:a6ff:fe61:6ed7 missed solicit interval
74 Mar 30 05:43:29.947 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
752024-03-30T05:43:29.979ZWARNslog-rs: stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out waiting 124.006713ms
76 Mar 30 05:43:29.982 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
77 Mar 30 05:43:30.114 DEBG registered DTrace probes
78 Mar 30 05:43:30.131 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
79 Mar 30 05:43:30.131 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
80 Mar 30 05:43:30.131 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
81 Mar 30 05:43:30.131 DEBG registering metric server as a producer
82 Mar 30 05:43:30.178 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::b]:12221/metrics/producers, method: POST
832024-03-30T05:43:33.144ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::6c80:a6ff:fe61:6ed7 missed solicit interval
84 Mar 30 05:43:45.183 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
852024-03-30T05:43:45.186ZWARNslog-rs: stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out waiting 140.445874ms
86 Mar 30 05:43:45.187 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
87 Mar 30 05:43:45.330 DEBG registered DTrace probes
88 Mar 30 05:43:45.331 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
89 Mar 30 05:43:45.331 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
90 Mar 30 05:43:45.332 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
91 Mar 30 05:43:45.332 DEBG registering metric server as a producer
92 Mar 30 05:43:45.366 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::b]:12221/metrics/producers, method: POST
93 Mar 30 05:44:00.368 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
94 Mar 30 05:44:00.369 INFO received request to begin graceful shutdown{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out waiting 136.426453ms","v":0,"name":"slog-rs","level":40,"time":"2024-03-30T05:44:00.369260191Z","hostname":"oxz_switch","pid":3996}
95 , local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
96 Mar 30 05:44:00.506 DEBG registered DTrace probes
97 Mar 30 05:44:00.506 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
98 Mar 30 05:44:00.506 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
99 Mar 30 05:44:00.506 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
100 Mar 30 05:44:00.506 DEBG registering metric server as a producer
101 Mar 30 05:44:00.535 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::b]:12221/metrics/producers, method: POST
102 Mar 30 05:44:15.513 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
103 Mar 30 05:44:15.514 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out waiting 291.380908ms","v":0,"name":"slog-rs","level":40,"time":"2024-03-30T05:44:15.514290952Z","hostname":"oxz_switch","pid":3996}
104 ]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
105 Mar 30 05:44:15.805 DEBG registered DTrace probes
106 Mar 30 05:44:15.805 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
107 Mar 30 05:44:15.806 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
108 Mar 30 05:44:15.806 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
109 Mar 30 05:44:15.806 DEBG registering metric server as a producer
110 Mar 30 05:44:15.834 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::b]:12221/metrics/producers, method: POST
111 Mar 30 05:44:30.794 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
112 Mar 30 05:44:30.796 INFO received request to begin graceful shutdown{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out waiting 235.454392ms","v":0,"name":"slog-rs","level":40,"time":"2024-03-30T05:44:30.796109691Z","hostname":"oxz_switch","pid":3996}
113 , local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
114 Mar 30 05:44:31.032 DEBG registered DTrace probes
115 Mar 30 05:44:31.032 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
116 Mar 30 05:44:31.032 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
117 Mar 30 05:44:31.032 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
118 Mar 30 05:44:31.032 DEBG registering metric server as a producer
119 Mar 30 05:44:31.067 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::b]:12221/metrics/producers, method: POST
1202024-03-30T05:44:40.432ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::6c80:a6ff:fe61:6ed7 expire
1212024-03-30T05:44:40.435ZWARNslog-rs: [tfportrear0_0] expiring peer fe80::6c80:a6ff:fe61:6ed7 due to discovery event
1222024-03-30T05:44:40.445ZINFOslog-rs: [tfportrear0_0] removing routes 5 from dendrite
1232024-03-30T05:44:41.731ZINFOslog-rs: [tfportrear0_0] nbr is fe80::6c80:a6ff:fe61:6ed7@buskin server
1242024-03-30T05:44:42.091ZERROslog-rs: [tfportrear0_0] failed to remove tunnel routes: {} OPTE driver is not attached
1252024-03-30T05:44:42.091ZDEBGslog-rs: [tfportrear0_0] redistributing expire to 0 peers
1262024-03-30T05:44:42.091ZDEBGslog-rs: [tfportrear0_0] transition solicit -> exchange
1272024-03-30T05:44:42.091ZINFOslog-rs: [tfportrear0_0] exchange: listening on [fe80::dc3f:61ff:fe81:82ee]:56797
1282024-03-30T05:44:42.091ZINFOslog-rs: [tfportrear0_0] waiting for exchange server to start
1292024-03-30T05:44:42.143ZINFOslog-rs: [tfportrear0_0] sending 5 routes to dendrite
1302024-03-30T05:44:42.143ZDEBGslog-rs: [tfportrear0_0] sending to dpd host=localhost port=12224
1312024-03-30T05:44:42.216ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:3:: -> fe80::6c80:a6ff:fe61:6ed7 on port Rear(RearPort(0))/0
1322024-03-30T05:44:42.223ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:1:: -> fe80::6c80:a6ff:fe61:6ed7 on port Rear(RearPort(0))/0
1332024-03-30T05:44:42.223ZINFOslog-rs: [tfportrear0_0] adding route fdb0:18c0:4d0d:9fb2:: -> fe80::6c80:a6ff:fe61:6ed7 on port Rear(RearPort(0))/0
1342024-03-30T05:44:42.223ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:101:: -> fe80::6c80:a6ff:fe61:6ed7 on port Rear(RearPort(0))/0
1352024-03-30T05:44:42.224ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:2:: -> fe80::6c80:a6ff:fe61:6ed7 on port Rear(RearPort(0))/0
1362024-03-30T05:44:42.225ZINFOslog-rs: [tfportrear0_0] removing routes 0 from dendrite
1372024-03-30T05:44:42.276ZDEBGslog-rs: [tfportrear0_0] redistributing update to 0 peers
138 Mar 30 05:44:46.309 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
139 Mar 30 05:44:46.363 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: {"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out waiting 271.710681ms","v":0,"name":"slog-rs","level":40,"time":"2024-03-30T05:44:46.364371557Z","hostname":"oxz_switch","pid":3996}
140 /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
141 Mar 30 05:44:46.639 DEBG registered DTrace probes
142 Mar 30 05:44:46.641 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
143 Mar 30 05:44:46.642 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
144 Mar 30 05:44:46.642 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
145 Mar 30 05:44:46.642 DEBG registering metric server as a producer
146 Mar 30 05:44:46.749 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::b]:12221/metrics/producers, method: POST
147 Mar 30 05:45:01.753 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
148 Mar 30 05:45:01.754 {"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out waiting 644.024727ms","v":0,"name":"slog-rs","level":40,"time":"2024-03-30T05:45:01.75445437Z","hostname":"oxz_switch","pid":3996}
149 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266