Max level shown:
1 [ Apr 29 04:08:26 Disabled. ]
2 [ Apr 29 04:08:26 Rereading configuration. ]
3 [ Apr 29 04:08:39 Rereading configuration. ]
4 [ Apr 29 04:08:39 Rereading configuration. ]
5 [ Apr 29 04:08:39 Enabled. ]
6 [ Apr 29 04:08:39 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/mg-ddm/pkg/ddm_method_script.sh &"). ]
7 [ Apr 29 04:08:39 Method "start" exited with status 0. ]
82024-04-29T04:08:39.170ZINFOslog-rs: signal handler waiting for context
92024-04-29T04:08:39.192ZINFOslog-rs: signal handler waiting got context
102024-04-29T04:08:39.192ZINFOslog-rs: [tfportrear0_0] sm initialized with addr fe80::84ab:41ff:fe99:2b8f on if tfportrear0_0 index 3
112024-04-29T04:08:39.192ZDEBGslog-rs: [tfportrear0_0] starting discovery handler
122024-04-29T04:08:39.193ZINFOslog-rs: admin: listening on [::1]:8000
13 [ Apr 29 04:08:40 Rereading configuration. ]
14 [ Apr 29 04:08:40 Executing refresh method ("/opt/oxide/mg-ddm/pkg/refresh_ctrun_child.sh -c 438"). ]
15 + CONTRACT=''
16 + getopts c: o
17 + CONTRACT=438
18 + getopts c: o
19 + [[ -n 438 ]]
20 + pgrep -c 438
21 + PARENT_PID=4037
22 + [[ -n 4037 ]]
23 + pgrep -P 4037
24 + CHILD_PID=4038
25 + [[ -n 4038 ]]
26 + kill -USR1 4038
272024-04-29T04:08:40.470ZINFOslog-rs: handling smf refresh
28 [ Apr 29 04:08:40 Method "refresh" exited with status 0. ]
292024-04-29T04:08:40.471ZINFOslog-rs: starting stats server on smf refresh
302024-04-29T04:08:40.472ZINFOslog-rs: resolving nexus
312024-04-29T04:08:40.472ZINFOslog-rs: new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53]
322024-04-29T04:08:40.559ZWARNslog-rs: [tfportrear0_0] admin event in solicit state: Announce(Underlay({Ipv6Prefix { addr: fde4:f909:8ddf:512::1, len: 64 }}))
332024-04-29T04:08:40.559ZINFOslog-rs: advertise tunnel: { TunnelOrigin { overlay_prefix: V4( Ipv4Prefix { addr: 0.0.0.0, len: 0, }, ), boundary_addr: fde4:f909:8ddf:512::1, vni: 99, metric: 100, }, }
342024-04-29T04:08:40.559ZWARNslog-rs: [tfportrear0_0] admin event in solicit state: Announce(Tunnel({TunnelOrigin { overlay_prefix: V4(Ipv4Prefix { addr: 0.0.0.0, len: 0 }), boundary_addr: fde4:f909:8ddf:512::1, vni: 99, metric: 100 }}))
352024-04-29T04:08:41.193ZINFOslog-rs: [tfportrear0_0] nbr is fe80::54cd:97ff:fe6e:c6b@sock server
362024-04-29T04:08:41.193ZDEBGslog-rs: [tfportrear0_0] transition solicit -> exchange
372024-04-29T04:08:41.193ZINFOslog-rs: [tfportrear0_0] exchange: listening on [fe80::84ab:41ff:fe99:2b8f]:56797
382024-04-29T04:08:41.193ZINFOslog-rs: [tfportrear0_0] waiting for exchange server to start
392024-04-29T04:08:41.195ZINFOslog-rs: [tfportrear0_0] sending 5 routes to dendrite
402024-04-29T04:08:41.195ZDEBGslog-rs: [tfportrear0_0] sending to dpd host=localhost port=12224
412024-04-29T04:08:41.233ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:3:: -> fe80::54cd:97ff:fe6e:c6b on port Rear(RearPort(0))/0
422024-04-29T04:08:41.235ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:101:: -> fe80::54cd:97ff:fe6e:c6b on port Rear(RearPort(0))/0
432024-04-29T04:08:41.235ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:1:: -> fe80::54cd:97ff:fe6e:c6b on port Rear(RearPort(0))/0
442024-04-29T04:08:41.235ZINFOslog-rs: [tfportrear0_0] adding route fdb0:18c0:4d0d:a02a:: -> fe80::54cd:97ff:fe6e:c6b on port Rear(RearPort(0))/0
452024-04-29T04:08:41.235ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:2:: -> fe80::54cd:97ff:fe6e:c6b on port Rear(RearPort(0))/0
462024-04-29T04:08:41.236ZINFOslog-rs: [tfportrear0_0] removing routes 0 from dendrite
472024-04-29T04:08:41.264ZDEBGslog-rs: [tfportrear0_0] redistributing update to 0 peers
482024-04-29T04:08:45.475ZDEBGslog-rs: lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("51231501-67c9-451e-a935-83aa38e09044.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a21507ee-5c96-4540-bc06-0852e4850905.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("be1fa9a1-301b-46b9-b30a-f282967efa55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("be1fa9a1-301b-46b9-b30a-f282967efa55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 930, tv_nsec: 475746792 } })
49 Apr 29 04:08:45.476 DEBG registered DTrace probes
50 Apr 29 04:08:45.477 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
51 Apr 29 04:08:45.477 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
52 Apr 29 04:08:45.477 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
53 Apr 29 04:08:45.477 DEBG registering metric server as a producer
54 Apr 29 04:08:45.506 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST
55 Apr 29 04:08:59.298 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
56 Apr 29 04:08:59.299 INFO received request to begin graceful shutdown, local_addr: [fd00:1122{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out waiting 110.33304ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-29T04:08:59.299093262Z","hostname":"oxz_switch","pid":4038}
57 :3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
58 Apr 29 04:08:59.410 DEBG registered DTrace probes
59 Apr 29 04:08:59.410 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
60 Apr 29 04:08:59.410 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
61 Apr 29 04:08:59.410 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
62 Apr 29 04:08:59.411 DEBG registering metric server as a producer
63 Apr 29 04:08:59.440 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST
642024-04-29T04:09:04.397ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::54cd:97ff:fe6e:c6b missed solicit interval
65 Apr 29 04:09:14.839 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
66 Apr 29 04:09:14.841 INFO received request to begin graceful shutdown, local_addr: [{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out waiting 129.798601ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-29T04:09:14.84104599Z","hostname":"oxz_switch","pid":4038}
67 fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
68 Apr 29 04:09:14.972 DEBG registered DTrace probes
69 Apr 29 04:09:14.972 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
70 Apr 29 04:09:14.972 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
71 Apr 29 04:09:14.972 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
72 Apr 29 04:09:14.972 DEBG registering metric server as a producer
73 Apr 29 04:09:15.020 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST
742024-04-29T04:09:27.221ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::54cd:97ff:fe6e:c6b missed solicit interval
75 Apr 29 04:09:30.029 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
76 Apr 29 04:09:30.033 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: {"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out waiting 214.577874ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-29T04:09:30.033672501Z","hostname":"oxz_switch","pid":4038}
77 /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
78 Apr 29 04:09:30.250 DEBG registered DTrace probes
79 Apr 29 04:09:30.252 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
80 Apr 29 04:09:30.252 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
81 Apr 29 04:09:30.252 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
82 Apr 29 04:09:30.252 DEBG registering metric server as a producer
83 Apr 29 04:09:30.298 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST
84 Apr 29 04:09:45.299 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
85 Apr 29 04:09:45.300 {"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out waiting 212.066622ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-29T04:09:45.300802138Z","hostname":"oxz_switch","pid":4038}
86 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
87 Apr 29 04:09:45.514 DEBG registered DTrace probes
88 Apr 29 04:09:45.514 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
89 Apr 29 04:09:45.514 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
90 Apr 29 04:09:45.514 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
91 Apr 29 04:09:45.514 DEBG registering metric server as a producer
92 Apr 29 04:09:45.543 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST
93 Apr 29 04:10:00.543 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
94 Apr 29 04:10:00.545 INFO received request to begin graceful shutdown{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out waiting 287.436552ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-29T04:10:00.54518386Z","hostname":"oxz_switch","pid":4038}
95 , local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
96 Apr 29 04:10:00.833 DEBG registered DTrace probes
97 Apr 29 04:10:00.833 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
98 Apr 29 04:10:00.833 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
99 Apr 29 04:10:00.833 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
100 Apr 29 04:10:00.833 DEBG registering metric server as a producer
101 Apr 29 04:10:00.862 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST
102 Apr 29 04:10:15.865 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
103 Apr 29 04:10:15.866 INFO received request to begin graceful shutdown{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out waiting 335.55287ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-29T04:10:15.866057312Z","hostname":"oxz_switch","pid":4038}
104 , local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
105 Apr 29 04:10:16.202 DEBG registered DTrace probes
106 Apr 29 04:10:16.202 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
107 Apr 29 04:10:16.203 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
108 Apr 29 04:10:16.203 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
109 Apr 29 04:10:16.203 DEBG registering metric server as a producer
110 Apr 29 04:10:16.232 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST
111 Apr 29 04:10:31.234 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
112 Apr 29 04:10:31.235 INFO {"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out waiting 349.957626ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-29T04:10:31.235420474Z","hostname":"oxz_switch","pid":4038}
113 received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
114 Apr 29 04:10:31.586 DEBG registered DTrace probes
115 Apr 29 04:10:31.586 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
116 Apr 29 04:10:31.586 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
117 Apr 29 04:10:31.587 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
118 Apr 29 04:10:31.587 DEBG registering metric server as a producer
119 Apr 29 04:10:31.623 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST
120 Apr 29 04:10:39.532 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
121 Apr 29 04:10:39.534{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146) waiting 388.891848ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-29T04:10:39.534451754Z","hostname":"oxz_switch","pid":4038}
122 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
123 Apr 29 04:10:39.924 DEBG registered DTrace probes
124 Apr 29 04:10:39.924 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
125 Apr 29 04:10:39.925 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
126 Apr 29 04:10:39.925 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
127 Apr 29 04:10:39.925 DEBG registering metric server as a producer
128 Apr 29 04:10:39.974 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST
129 Apr 29 04:10:39.975 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
1302024-04-29T04:10:39.976ZWARNslog-rs: stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146) waiting 231.631163ms
131 Apr 29 04:10:39.976 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
132 Apr 29 04:10:40.208 DEBG registered DTrace probes
133 Apr 29 04:10:40.208 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
134 Apr 29 04:10:40.208 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
135 Apr 29 04:10:40.209 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
136 Apr 29 04:10:40.209 DEBG registering metric server as a producer
137 Apr 29 04:10:40.245 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST
138 Apr 29 04:10:40.245 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
139 Apr 29 04:10:40.246{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146) waiting 532.624191ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-29T04:10:40.24621685Z","hostname":"oxz_switch","pid":4038}
140 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
141 Apr 29 04:10:40.779 DEBG registered DTrace probes
142 Apr 29 04:10:40.779 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
143 Apr 29 04:10:40.779 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
144 Apr 29 04:10:40.779 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
145 Apr 29 04:10:40.779 DEBG registering metric server as a producer
146 Apr 29 04:10:40.809 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST
147 Apr 29 04:10:40.809 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
148 Apr 29 04:10:40.810 INFO received request to begin graceful shutdown, {"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146) waiting 712.021924ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-29T04:10:40.810199046Z","hostname":"oxz_switch","pid":4038}
149 local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
150 Apr 29 04:10:41.523 DEBG registered DTrace probes
151 Apr 29 04:10:41.523 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
152 Apr 29 04:10:41.524 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
153 Apr 29 04:10:41.524 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
154 Apr 29 04:10:41.524 DEBG registering metric server as a producer
155 Apr 29 04:10:41.553 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST
156 Apr 29 04:10:41.553 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
157 Apr 29 04:10:41.554 INFO received request to begin graceful shutdown, local_addr: [fd00{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146) waiting 1.052140672s","v":0,"name":"slog-rs","level":40,"time":"2024-04-29T04:10:41.554257904Z","hostname":"oxz_switch","pid":4038}
158 :1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
159 Apr 29 04:10:42.607 DEBG registered DTrace probes
160 Apr 29 04:10:42.607 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
161 Apr 29 04:10:42.607 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
162 Apr 29 04:10:42.607 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
163 Apr 29 04:10:42.607 DEBG registering metric server as a producer
164 Apr 29 04:10:42.636 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST
165 Apr 29 04:10:42.636 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
166 Apr 29 04:10:42.637 INFO {"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146) waiting 977.597804ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-29T04:10:42.637127121Z","hostname":"oxz_switch","pid":4038}
167 received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
168 Apr 29 04:10:43.616 DEBG registered DTrace probes
169 Apr 29 04:10:43.616 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
170 Apr 29 04:10:43.616 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
171 Apr 29 04:10:43.616 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
172 Apr 29 04:10:43.616 DEBG registering metric server as a producer
173 Apr 29 04:10:43.645 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST
174 Apr 29 04:10:43.645 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
175 Apr 29 04:10:43.645 INFO received request to begin graceful shutdown{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146) waiting 937.379082ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-29T04:10:43.645676423Z","hostname":"oxz_switch","pid":4038}
176 , local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
177 Apr 29 04:10:44.584 DEBG registered DTrace probes
178 Apr 29 04:10:44.584 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
179 Apr 29 04:10:44.584 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
180 Apr 29 04:10:44.584 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
181 Apr 29 04:10:44.584 DEBG registering metric server as a producer
182 Apr 29 04:10:44.613 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST
183 Apr 29 04:10:44.613 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
184 Apr 29 04:10:44.614 INFO received request to begin graceful shutdown, local_addr{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146) waiting 753.525128ms","v":0,"name":"slog-rs","level":40,"time":"2024-04-29T04:10:44.614314697Z","hostname":"oxz_switch","pid":4038}
185 : [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
186 Apr 29 04:10:45.368 DEBG registered DTrace probes
187 Apr 29 04:10:45.369 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
188 Apr 29 04:10:45.369 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
189 Apr 29 04:10:45.369 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
190 Apr 29 04:10:45.369 DEBG registering metric server as a producer
191 Apr 29 04:10:45.398 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST
192 Apr 29 04:10:45.398 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
193 Apr 29 04:10:45.398 INFO received request to begin graceful shutdown, local_addr: [fd00:{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146) waiting 1.409120233s","v":0,"name":"slog-rs","level":40,"time":"2024-04-29T04:10:45.398994839Z","hostname":"oxz_switch","pid":4038}
194 1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
195 Apr 29 04:10:46.809 DEBG registered DTrace probes
196 Apr 29 04:10:46.809 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
197 Apr 29 04:10:46.809 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
198 Apr 29 04:10:46.809 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
199 Apr 29 04:10:46.809 DEBG registering metric server as a producer
200 Apr 29 04:10:46.838 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST
201 Apr 29 04:10:46.838 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
202 Apr 29 04:10:46.838 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
2032024-04-29T04:10:46.838ZWARNslog-rs: stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146) waiting 2.462160634s
204 Apr 29 04:10:49.301 DEBG registered DTrace probes
205 Apr 29 04:10:49.301 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
206 Apr 29 04:10:49.302 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
207 Apr 29 04:10:49.302 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
208 Apr 29 04:10:49.302 DEBG registering metric server as a producer
209 Apr 29 04:10:49.336 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST
210 Apr 29 04:10:49.336 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
211 Apr 29 04:10:49.337 {"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146) waiting 1.893408911s","v":0,"name":"slog-rs","level":40,"time":"2024-04-29T04:10:49.337083758Z","hostname":"oxz_switch","pid":4038}
212 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
213 Apr 29 04:10:51.232 DEBG registered DTrace probes
214 Apr 29 04:10:51.232 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
215 Apr 29 04:10:51.232 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
216 Apr 29 04:10:51.232 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
217 Apr 29 04:10:51.232 DEBG registering metric server as a producer
218 Apr 29 04:10:51.261 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::c]:12221/metrics/producers, method: POST
219 Apr 29 04:10:51.327 DEBG client response, result: Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "f33e9f8d-5772-4336-8c99-3cf6b4890446", "content-length": "41", "date": "Mon, 29 Apr 2024 04:10:51 GMT"} })
220 Apr 29 04:10:51.329 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266