Max level shown:
1 [ Apr 1 23:09:27 Disabled. ]
2 [ Apr 1 23:09:27 Rereading configuration. ]
3 [ Apr 1 23:09:41 Rereading configuration. ]
4 [ Apr 1 23:09:41 Rereading configuration. ]
5 [ Apr 1 23:09:41 Enabled. ]
6 [ Apr 1 23:09:41 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/mg-ddm/pkg/ddm_method_script.sh &"). ]
7 [ Apr 1 23:09:41 Method "start" exited with status 0. ]
82024-04-01T23:09:41.555ZINFOslog-rs: signal handler waiting for context
92024-04-01T23:09:41.575ZINFOslog-rs: signal handler waiting got context
102024-04-01T23:09:41.576ZINFOslog-rs: [tfportrear0_0] sm initialized with addr fe80::743d:3bff:fec7:fe20 on if tfportrear0_0 index 3
112024-04-01T23:09:41.576ZDEBGslog-rs: [tfportrear0_0] starting discovery handler
122024-04-01T23:09:41.577ZINFOslog-rs: admin: listening on [::1]:8000
13 [ Apr 1 23:09:42 Rereading configuration. ]
14 [ Apr 1 23:09:42 Executing refresh method ("/opt/oxide/mg-ddm/pkg/refresh_ctrun_child.sh -c 445"). ]
15 + CONTRACT=''
16 + getopts c: o
17 + CONTRACT=445
18 + getopts c: o
19 + [[ -n 445 ]]
20 + pgrep -c 445
21 + PARENT_PID=4263
22 + [[ -n 4263 ]]
23 + pgrep -P 4263
24 + CHILD_PID=4264
25 + [[ -n 4264 ]]
26 + kill -USR1 4264
272024-04-01T23:09:42.925ZINFOslog-rs: handling smf refresh
28 [ Apr 1 23:09:42 Method "refresh" exited with status 0. ]
292024-04-01T23:09:42.927ZINFOslog-rs: starting stats server on smf refresh
302024-04-01T23:09:42.927ZINFOslog-rs: resolving nexus
312024-04-01T23:09:42.928ZINFOslog-rs: new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53]
322024-04-01T23:09:43.000ZWARNslog-rs: [tfportrear0_0] admin event in solicit state: Announce(Underlay({Ipv6Prefix { addr: fddc:d3f4:e554:b6e9::1, len: 64 }}))
332024-04-01T23:09:43.000ZINFOslog-rs: advertise tunnel: { TunnelOrigin { overlay_prefix: V4( Ipv4Prefix { addr: 0.0.0.0, len: 0, }, ), boundary_addr: fddc:d3f4:e554:b6e9::1, vni: 99, metric: 100, }, }
342024-04-01T23:09:43.000ZWARNslog-rs: [tfportrear0_0] admin event in solicit state: Announce(Tunnel({TunnelOrigin { overlay_prefix: V4(Ipv4Prefix { addr: 0.0.0.0, len: 0 }), boundary_addr: fddc:d3f4:e554:b6e9::1, vni: 99, metric: 100 }}))
352024-04-01T23:09:43.576ZINFOslog-rs: [tfportrear0_0] nbr is fe80::70d3:52ff:fe5f:6f62@buskin server
362024-04-01T23:09:43.576ZDEBGslog-rs: [tfportrear0_0] transition solicit -> exchange
372024-04-01T23:09:43.576ZINFOslog-rs: [tfportrear0_0] exchange: listening on [fe80::743d:3bff:fec7:fe20]:56797
382024-04-01T23:09:43.577ZINFOslog-rs: [tfportrear0_0] waiting for exchange server to start
392024-04-01T23:09:43.578ZINFOslog-rs: [tfportrear0_0] sending 5 routes to dendrite
402024-04-01T23:09:43.578ZDEBGslog-rs: [tfportrear0_0] sending to dpd host=localhost port=12224
412024-04-01T23:09:43.617ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:1:: -> fe80::70d3:52ff:fe5f:6f62 on port Rear(RearPort(0))/0
422024-04-01T23:09:43.618ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:101:: -> fe80::70d3:52ff:fe5f:6f62 on port Rear(RearPort(0))/0
432024-04-01T23:09:43.618ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:3:: -> fe80::70d3:52ff:fe5f:6f62 on port Rear(RearPort(0))/0
442024-04-01T23:09:43.619ZINFOslog-rs: [tfportrear0_0] adding route fdb0:200:: -> fe80::70d3:52ff:fe5f:6f62 on port Rear(RearPort(0))/0
452024-04-01T23:09:43.619ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:2:: -> fe80::70d3:52ff:fe5f:6f62 on port Rear(RearPort(0))/0
462024-04-01T23:09:43.620ZINFOslog-rs: [tfportrear0_0] removing routes 0 from dendrite
472024-04-01T23:09:43.648ZDEBGslog-rs: [tfportrear0_0] redistributing update to 0 peers
482024-04-01T23:09:47.931ZWARNslog-rs: resolving nexus failed, no record found for Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } waiting 118.986274ms
492024-04-01T23:09:48.051ZDEBGslog-rs: lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("55d0de72-8b3a-43ce-b584-ca3719aec4fb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("7b41cf58-76b0-41d4-bb67-d44db262a3a6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("d39f83ee-7b83-426f-8bcf-8b030f08649b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d39f83ee-7b83-426f-8bcf-8b030f08649b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 836, tv_nsec: 624703249 } })
50 Apr 01 23:09:48.053 DEBG registered DTrace probes
51 Apr 01 23:09:48.053 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
52 Apr 01 23:09:48.053 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
53 Apr 01 23:09:48.053 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
54 Apr 01 23:09:48.054 DEBG registering metric server as a producer
55 Apr 01 23:09:48.083 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
56 Apr 01 23:10:03.084 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
57 Apr 01 23:10:03.085 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 60.325019ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-01T23:10:03.085754867Z","hostname":"oxz_switch","pid":4264}
58 3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
59 Apr 01 23:10:03.148 DEBG registered DTrace probes
60 Apr 01 23:10:03.148 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
61 Apr 01 23:10:03.148 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
62 Apr 01 23:10:03.148 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
63 Apr 01 23:10:03.148 DEBG registering metric server as a producer
64 Apr 01 23:10:03.177 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
65 Apr 01 23:10:18.178 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
66 Apr 01 23:10:18.179 INFO received request to begin graceful shutdown{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 90.850923ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-01T23:10:18.179896679Z","hostname":"oxz_switch","pid":4264}
67 , local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
68 Apr 01 23:10:18.271 DEBG registered DTrace probes
69 Apr 01 23:10:18.271 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
70 Apr 01 23:10:18.271 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
71 Apr 01 23:10:18.271 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
72 Apr 01 23:10:18.271 DEBG registering metric server as a producer
73 Apr 01 23:10:18.299 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
74 Apr 01 23:10:33.300 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
75 Apr 01 23:10:33.301 INFO received request to begin graceful shutdown, local_addr: {"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 119.759397ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-01T23:10:33.301490917Z","hostname":"oxz_switch","pid":4264}
76 [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
77 Apr 01 23:10:33.422 DEBG registered DTrace probes
78 Apr 01 23:10:33.422 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
79 Apr 01 23:10:33.423 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
80 Apr 01 23:10:33.423 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
81 Apr 01 23:10:33.423 DEBG registering metric server as a producer
82 Apr 01 23:10:33.451 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
83 Apr 01 23:10:48.452 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
84 Apr 01 23:10:48.454 INFO received request to begin graceful shutdown{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 145.465928ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-01T23:10:48.45406149Z","hostname":"oxz_switch","pid":4264}
85 , local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
86 Apr 01 23:10:48.600 DEBG registered DTrace probes
87 Apr 01 23:10:48.600 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
88 Apr 01 23:10:48.600 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
89 Apr 01 23:10:48.600 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
90 Apr 01 23:10:48.600 DEBG registering metric server as a producer
91 Apr 01 23:10:48.629 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
92 Apr 01 23:11:03.630 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
93 Apr 01 23:11:03.632 INFO received request to begin graceful shutdown{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 133.857404ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-01T23:11:03.632223173Z","hostname":"oxz_switch","pid":4264}
94 , local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
95 Apr 01 23:11:03.767 DEBG registered DTrace probes
96 Apr 01 23:11:03.767 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
97 Apr 01 23:11:03.767 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
98 Apr 01 23:11:03.768 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
99 Apr 01 23:11:03.768 DEBG registering metric server as a producer
100 Apr 01 23:11:03.796 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
101 Apr 01 23:11:18.797 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
102 Apr 01 23:11:18.798 INFO{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 274.781535ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-01T23:11:18.79861862Z","hostname":"oxz_switch","pid":4264}
103 received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
104 Apr 01 23:11:19.075 DEBG registered DTrace probes
105 Apr 01 23:11:19.075 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
106 Apr 01 23:11:19.075 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
107 Apr 01 23:11:19.075 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
108 Apr 01 23:11:19.075 DEBG registering metric server as a producer
109 Apr 01 23:11:19.103 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
110 Apr 01 23:11:34.104 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
111 Apr 01 23:11:34.106 INFO received request to begin graceful shutdown, local_addr:{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 168.384519ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-01T23:11:34.106232616Z","hostname":"oxz_switch","pid":4264}
112 [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
113 Apr 01 23:11:34.275 DEBG registered DTrace probes
114 Apr 01 23:11:34.275 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
115 Apr 01 23:11:34.276 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
116 Apr 01 23:11:34.276 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
117 Apr 01 23:11:34.276 DEBG registering metric server as a producer
118 Apr 01 23:11:34.304 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
119 Apr 01 23:11:49.305 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
120 Apr 01 23:11:49.306 INFO received request to begin graceful shutdown, local_addr: [fd00{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 339.752804ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-01T23:11:49.306870194Z","hostname":"oxz_switch","pid":4264}
121 :1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
122 Apr 01 23:11:49.647 DEBG registered DTrace probes
123 Apr 01 23:11:49.647 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
124 Apr 01 23:11:49.647 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
125 Apr 01 23:11:49.647 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
126 Apr 01 23:11:49.647 DEBG registering metric server as a producer
127 Apr 01 23:11:49.676 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
128 Apr 01 23:12:04.677 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
129 Apr 01 23:12:04.678 INFO received request to begin graceful shutdown, local_addr{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 476.854723ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-01T23:12:04.678292949Z","hostname":"oxz_switch","pid":4264}
130 : [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
131 Apr 01 23:12:05.156 DEBG registered DTrace probes
132 Apr 01 23:12:05.156 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
133 Apr 01 23:12:05.156 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
134 Apr 01 23:12:05.156 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
135 Apr 01 23:12:05.156 DEBG registering metric server as a producer
136 Apr 01 23:12:05.185 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
137 Apr 01 23:12:20.186 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
138 Apr 01 23:12:20.187 INFO received request to begin graceful shutdown, local_addr: {"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 763.469232ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-01T23:12:20.187950919Z","hostname":"oxz_switch","pid":4264}
139 [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
140 Apr 01 23:12:20.953 DEBG registered DTrace probes
141 Apr 01 23:12:20.953 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
142 Apr 01 23:12:20.953 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
143 Apr 01 23:12:20.953 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
144 Apr 01 23:12:20.953 DEBG registering metric server as a producer
145 Apr 01 23:12:20.981 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
146 Apr 01 23:12:35.983 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
147 Apr 01 23:12:35.984 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 505.961879ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-01T23:12:35.984366479Z","hostname":"oxz_switch","pid":4264}
148 ::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
149 Apr 01 23:12:36.491 DEBG registered DTrace probes
150 Apr 01 23:12:36.491 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
151 Apr 01 23:12:36.491 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
152 Apr 01 23:12:36.492 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
153 Apr 01 23:12:36.492 DEBG registering metric server as a producer
154 Apr 01 23:12:36.520 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
155 Apr 01 23:12:51.521 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
156 Apr 01 23:12:51.522 INFO {"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 984.555789ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-01T23:12:51.522555787Z","hostname":"oxz_switch","pid":4264}
157 received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
158 Apr 01 23:12:52.509 DEBG registered DTrace probes
159 Apr 01 23:12:52.509 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
160 Apr 01 23:12:52.509 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
161 Apr 01 23:12:52.509 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
162 Apr 01 23:12:52.509 DEBG registering metric server as a producer
163 Apr 01 23:12:52.537 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
164 Apr 01 23:13:07.538 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
165 Apr 01 23:13:07.539 INFO received request to begin graceful shutdown, local_addr: [fd00:{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 447.937197ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-01T23:13:07.539612061Z","hostname":"oxz_switch","pid":4264}
166 1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
167 Apr 01 23:13:07.988 DEBG registered DTrace probes
168 Apr 01 23:13:07.989 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
169 Apr 01 23:13:07.989 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
170 Apr 01 23:13:07.989 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
171 Apr 01 23:13:07.989 DEBG registering metric server as a producer
172 Apr 01 23:13:08.017 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
173 Apr 01 23:13:23.018 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
174 Apr 01 23:13:23.019 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 563.293735ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-01T23:13:23.019941407Z","hostname":"oxz_switch","pid":4264}
175 ]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
176 Apr 01 23:13:23.584 DEBG registered DTrace probes
177 Apr 01 23:13:23.584 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
178 Apr 01 23:13:23.585 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
179 Apr 01 23:13:23.585 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
180 Apr 01 23:13:23.585 DEBG registering metric server as a producer
181 Apr 01 23:13:23.613 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
182 Apr 01 23:13:38.614 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
183 Apr 01 23:13:38.615 INFO received request to begin graceful shutdown, local_addr: [fd00:1122{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 1.454395847s","v":0,"name":"slog-rs","level":40,"time":"2024-04-01T23:13:38.615895776Z","hostname":"oxz_switch","pid":4264}
184 :3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
185 Apr 01 23:13:40.071 DEBG registered DTrace probes
186 Apr 01 23:13:40.072 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
187 Apr 01 23:13:40.072 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
188 Apr 01 23:13:40.072 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
189 Apr 01 23:13:40.072 DEBG registering metric server as a producer
190 Apr 01 23:13:40.100 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
191 Apr 01 23:13:55.101 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
192 Apr 01 23:13:55.102 INFO received request to begin graceful shutdown, local_addr: {"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 1.124605926s","v":0,"name":"slog-rs","level":40,"time":"2024-04-01T23:13:55.102696239Z","hostname":"oxz_switch","pid":4264}
193 [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
194 Apr 01 23:13:56.228 DEBG registered DTrace probes
195 Apr 01 23:13:56.228 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
196 Apr 01 23:13:56.228 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
197 Apr 01 23:13:56.228 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
198 Apr 01 23:13:56.228 DEBG registering metric server as a producer
199 Apr 01 23:13:56.256 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
200 Apr 01 23:14:11.257 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
201 Apr 01 23:14:11.258 INFO received request to begin graceful shutdown, local_addr: [fd00:1122{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 1.929867317s","v":0,"name":"slog-rs","level":40,"time":"2024-04-01T23:14:11.258517653Z","hostname":"oxz_switch","pid":4264}
202 :3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
203 Apr 01 23:14:13.189 DEBG registered DTrace probes
204 Apr 01 23:14:13.189 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
205 Apr 01 23:14:13.189 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
206 Apr 01 23:14:13.189 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
207 Apr 01 23:14:13.189 DEBG registering metric server as a producer
208 Apr 01 23:14:13.218 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
209 Apr 01 23:14:28.219 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
210 Apr 01 23:14:28.220 INFO received request to begin graceful shutdown, {"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 1.631252701s","v":0,"name":"slog-rs","level":40,"time":"2024-04-01T23:14:28.220951818Z","hostname":"oxz_switch","pid":4264}
211 local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
212 Apr 01 23:14:29.853 DEBG registered DTrace probes
213 Apr 01 23:14:29.853 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
214 Apr 01 23:14:29.853 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
215 Apr 01 23:14:29.854 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
216 Apr 01 23:14:29.854 DEBG registering metric server as a producer
217 Apr 01 23:14:29.882 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
218 Apr 01 23:14:44.883 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
219 Apr 01 23:14:44.884 INFO received request to begin graceful shutdown, local_addr: [{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 3.600840204s","v":0,"name":"slog-rs","level":40,"time":"2024-04-01T23:14:44.884550786Z","hostname":"oxz_switch","pid":4264}
220 fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
221 Apr 01 23:14:48.486 DEBG registered DTrace probes
222 Apr 01 23:14:48.486 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
223 Apr 01 23:14:48.486 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
224 Apr 01 23:14:48.486 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
225 Apr 01 23:14:48.486 DEBG registering metric server as a producer
226 Apr 01 23:14:48.515 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST