Max level shown:
1 [ May 1 00:16:50 Disabled. ]
2 [ May 1 00:16:50 Rereading configuration. ]
3 [ May 1 00:17:03 Rereading configuration. ]
4 [ May 1 00:17:03 Rereading configuration. ]
5 [ May 1 00:17:03 Enabled. ]
6 [ May 1 00:17:03 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/mg-ddm/pkg/ddm_method_script.sh &"). ]
7 [ May 1 00:17:03 Method "start" exited with status 0. ]
82024-05-01T00:17:03.544ZINFOslog-rs: signal handler waiting for context
92024-05-01T00:17:03.561ZINFOslog-rs: signal handler waiting got context
102024-05-01T00:17:03.562ZINFOslog-rs: [tfportrear0_0] sm initialized with addr fe80::c51:5fff:feb6:a785 on if tfportrear0_0 index 3
112024-05-01T00:17:03.562ZDEBGslog-rs: [tfportrear0_0] starting discovery handler
122024-05-01T00:17:03.562ZINFOslog-rs: admin: listening on [::1]:8000
13 [ May 1 00:17:04 Rereading configuration. ]
14 [ May 1 00:17:04 Executing refresh method ("/opt/oxide/mg-ddm/pkg/refresh_ctrun_child.sh -c 438"). ]
15 + CONTRACT=''
16 + getopts c: o
17 + CONTRACT=438
18 + getopts c: o
19 + [[ -n 438 ]]
20 + pgrep -c 438
21 + PARENT_PID=3964
22 + [[ -n 3964 ]]
23 + pgrep -P 3964
24 + CHILD_PID=3965
25 + [[ -n 3965 ]]
26 + kill -USR1 3965
272024-05-01T00:17:04.834ZINFOslog-rs: handling smf refresh
28 [ May 1 00:17:04 Method "refresh" exited with status 0. ]
292024-05-01T00:17:04.836ZINFOslog-rs: starting stats server on smf refresh
302024-05-01T00:17:04.836ZINFOslog-rs: resolving nexus
312024-05-01T00:17:04.836ZINFOslog-rs: new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53]
322024-05-01T00:17:04.915ZWARNslog-rs: [tfportrear0_0] admin event in solicit state: Announce(Underlay({Ipv6Prefix { addr: fdb3:b857:1ab1:a322::1, len: 64 }}))
332024-05-01T00:17:04.915ZINFOslog-rs: advertise tunnel: { TunnelOrigin { overlay_prefix: V4( Ipv4Prefix { addr: 0.0.0.0, len: 0, }, ), boundary_addr: fdb3:b857:1ab1:a322::1, vni: 99, metric: 100, }, }
342024-05-01T00:17:04.915ZWARNslog-rs: [tfportrear0_0] admin event in solicit state: Announce(Tunnel({TunnelOrigin { overlay_prefix: V4(Ipv4Prefix { addr: 0.0.0.0, len: 0 }), boundary_addr: fdb3:b857:1ab1:a322::1, vni: 99, metric: 100 }}))
352024-05-01T00:17:05.562ZINFOslog-rs: [tfportrear0_0] nbr is fe80::f8f6:6fff:fe53:ce07@buskin server
362024-05-01T00:17:05.562ZDEBGslog-rs: [tfportrear0_0] transition solicit -> exchange
372024-05-01T00:17:05.562ZINFOslog-rs: [tfportrear0_0] exchange: listening on [fe80::c51:5fff:feb6:a785]:56797
382024-05-01T00:17:05.563ZINFOslog-rs: [tfportrear0_0] waiting for exchange server to start
392024-05-01T00:17:05.564ZINFOslog-rs: [tfportrear0_0] sending 5 routes to dendrite
402024-05-01T00:17:05.564ZDEBGslog-rs: [tfportrear0_0] sending to dpd host=localhost port=12224
412024-05-01T00:17:05.603ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:2:: -> fe80::f8f6:6fff:fe53:ce07 on port Rear(RearPort(0))/0
422024-05-01T00:17:05.605ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:1:: -> fe80::f8f6:6fff:fe53:ce07 on port Rear(RearPort(0))/0
432024-05-01T00:17:05.605ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:3:: -> fe80::f8f6:6fff:fe53:ce07 on port Rear(RearPort(0))/0
442024-05-01T00:17:05.605ZINFOslog-rs: [tfportrear0_0] adding route fdb0:18c0:4d0d:9fb2:: -> fe80::f8f6:6fff:fe53:ce07 on port Rear(RearPort(0))/0
452024-05-01T00:17:05.605ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:101:: -> fe80::f8f6:6fff:fe53:ce07 on port Rear(RearPort(0))/0
462024-05-01T00:17:05.606ZINFOslog-rs: [tfportrear0_0] removing routes 0 from dendrite
472024-05-01T00:17:05.634ZDEBGslog-rs: [tfportrear0_0] redistributing update to 0 peers
482024-05-01T00:17:09.840ZDEBGslog-rs: lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("5440be3c-47a7-4c5f-bac9-47f00b0ba6eb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9a5c21b7-6d47-4773-9ae5-0cfab0623b23.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("e517e38c-3218-4379-a038-fee6d2241dcc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e517e38c-3218-4379-a038-fee6d2241dcc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 1370, tv_nsec: 768619370 } })
49 May 01 00:17:09.842 DEBG registered DTrace probes
50 May 01 00:17:09.842 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
51 May 01 00:17:09.842 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
52 May 01 00:17:09.842 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
53 May 01 00:17:09.842 DEBG registering metric server as a producer
54 May 01 00:17:09.872 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
55 May 01 00:17:23.914 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
56 May 01 00:17:23.915 INFO{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 112.314807ms","v":0,"name":"slog-rs","level":40,"time":"2024-05-01T00:17:23.915323436Z","hostname":"oxz_switch","pid":3965}
57 received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
58 May 01 00:17:24.028 DEBG registered DTrace probes
59 May 01 00:17:24.028 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
60 May 01 00:17:24.028 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
61 May 01 00:17:24.029 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
62 May 01 00:17:24.029 DEBG registering metric server as a producer
63 May 01 00:17:24.058 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
64 May 01 00:17:39.089 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
65 May 01 00:17:39.090 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
662024-05-01T00:17:39.090ZWARNslog-rs: stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 106.971476ms
67 May 01 00:17:39.198 DEBG registered DTrace probes
68 May 01 00:17:39.198 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
69 May 01 00:17:39.199 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
70 May 01 00:17:39.199 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
71 May 01 00:17:39.199 DEBG registering metric server as a producer
72 May 01 00:17:39.247 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
73 May 01 00:17:54.248 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
74 May 01 00:17:54.249 INFO {"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 98.283775ms","v":0,"name":"slog-rs","level":40,"time":"2024-05-01T00:17:54.249954873Z","hostname":"oxz_switch","pid":3965}
75 received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
76 May 01 00:17:54.349 DEBG registered DTrace probes
77 May 01 00:17:54.349 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
78 May 01 00:17:54.349 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
79 May 01 00:17:54.349 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
80 May 01 00:17:54.349 DEBG registering metric server as a producer
81 May 01 00:17:54.379 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
82 May 01 00:18:09.380 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
83 May 01 00:18:09.382 INFO received request to begin graceful shutdown, local_addr: [fd00:1122{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 229.946212ms","v":0,"name":"slog-rs","level":40,"time":"2024-05-01T00:18:09.382127563Z","hostname":"oxz_switch","pid":3965}
84 :3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
85 May 01 00:18:09.613 DEBG registered DTrace probes
86 May 01 00:18:09.613 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
87 May 01 00:18:09.613 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
88 May 01 00:18:09.613 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
89 May 01 00:18:09.614 DEBG registering metric server as a producer
90 May 01 00:18:09.643 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
91 May 01 00:18:24.643 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
92 May 01 00:18:24.644 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
932024-05-01T00:18:24.644ZWARNslog-rs: stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 215.765691ms
94 May 01 00:18:24.861 DEBG registered DTrace probes
95 May 01 00:18:24.861 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
96 May 01 00:18:24.861 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
97 May 01 00:18:24.861 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
98 May 01 00:18:24.861 DEBG registering metric server as a producer
99 May 01 00:18:24.890 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
100 May 01 00:18:39.891 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
101 May 01 00:18:39.892 {"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 299.635992ms","v":0,"name":"slog-rs","level":40,"time":"2024-05-01T00:18:39.892704955Z","hostname":"oxz_switch","pid":3965}
102 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
103 May 01 00:18:40.193 DEBG registered DTrace probes
104 May 01 00:18:40.193 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
105 May 01 00:18:40.193 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
106 May 01 00:18:40.193 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
107 May 01 00:18:40.193 DEBG registering metric server as a producer
108 May 01 00:18:40.224 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
109 May 01 00:18:55.225 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
110 May 01 00:18:55.226 INFO {"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 337.455428ms","v":0,"name":"slog-rs","level":40,"time":"2024-05-01T00:18:55.226247838Z","hostname":"oxz_switch","pid":3965}
111 received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
112 May 01 00:18:55.564 DEBG registered DTrace probes
113 May 01 00:18:55.564 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
114 May 01 00:18:55.564 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
115 May 01 00:18:55.565 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
116 May 01 00:18:55.565 DEBG registering metric server as a producer
117 May 01 00:18:55.594 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
118 May 01 00:19:10.595 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
119 May 01 00:19:10.596 INFO received request to begin graceful shutdown, {"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 428.846835ms","v":0,"name":"slog-rs","level":40,"time":"2024-05-01T00:19:10.596909592Z","hostname":"oxz_switch","pid":3965}
120 local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
121 May 01 00:19:11.026 DEBG registered DTrace probes
122 May 01 00:19:11.026 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
123 May 01 00:19:11.026 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
124 May 01 00:19:11.026 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
125 May 01 00:19:11.026 DEBG registering metric server as a producer
126 May 01 00:19:11.055 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
127 May 01 00:19:26.056 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
128 May 01 00:19:26.057 INFO received request to begin graceful shutdown{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 344.978201ms","v":0,"name":"slog-rs","level":40,"time":"2024-05-01T00:19:26.05781788Z","hostname":"oxz_switch","pid":3965}
129 , local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
130 May 01 00:19:26.403 DEBG registered DTrace probes
131 May 01 00:19:26.403 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
132 May 01 00:19:26.403 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
133 May 01 00:19:26.403 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
134 May 01 00:19:26.403 DEBG registering metric server as a producer
135 May 01 00:19:26.432 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
136 May 01 00:19:41.436 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
137 May 01 00:19:41.438 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
1382024-05-01T00:19:41.438ZWARNslog-rs: stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 705.676118ms
139 May 01 00:19:42.144 DEBG registered DTrace probes
140 May 01 00:19:42.144 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
141 May 01 00:19:42.144 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
142 May 01 00:19:42.144 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
143 May 01 00:19:42.144 DEBG registering metric server as a producer
144 May 01 00:19:42.174 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
145 May 01 00:19:57.221 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
1462024-05-01T00:19:57.476ZWARNslog-rs: stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 521.961244ms
147 May 01 00:19:57.476 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
148 May 01 00:19:58.001 DEBG registered DTrace probes
149 May 01 00:19:58.003 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
150 May 01 00:19:58.004 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
151 May 01 00:19:58.004 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
152 May 01 00:19:58.004 DEBG registering metric server as a producer
153 May 01 00:19:58.060 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
154 May 01 00:20:13.061 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut })
1552024-05-01T00:20:13.062ZWARNslog-rs: stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out waiting 853.406598ms
156 May 01 00:20:13.062 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
157 May 01 00:20:13.917 DEBG registered DTrace probes
158 May 01 00:20:13.917 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
159 May 01 00:20:13.917 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
160 May 01 00:20:13.917 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
161 May 01 00:20:13.917 DEBG registering metric server as a producer
162 May 01 00:20:13.946 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
163 May 01 00:20:17.342 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
164 May 01 00:20:17.344 INFO{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146) waiting 893.729279ms","v":0,"name":"slog-rs","level":40,"time":"2024-05-01T00:20:17.344046599Z","hostname":"oxz_switch","pid":3965}
165 received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
166 May 01 00:20:18.238 DEBG registered DTrace probes
167 May 01 00:20:18.238 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
168 May 01 00:20:18.238 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
169 May 01 00:20:18.238 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
170 May 01 00:20:18.239 DEBG registering metric server as a producer
171 May 01 00:20:18.275 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
172 May 01 00:20:18.276 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
173 May 01 00:20:18.276 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
1742024-05-01T00:20:18.276ZWARNslog-rs: stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146) waiting 1.103552854s
175 May 01 00:20:19.382 DEBG registered DTrace probes
176 May 01 00:20:19.382 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
177 May 01 00:20:19.382 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
178 May 01 00:20:19.382 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
179 May 01 00:20:19.382 DEBG registering metric server as a producer
180 May 01 00:20:19.416 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
181 May 01 00:20:19.416 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
182 May 01 00:20:19.417 INFO received request to begin graceful shutdown{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146) waiting 1.018050583s","v":0,"name":"slog-rs","level":40,"time":"2024-05-01T00:20:19.417119386Z","hostname":"oxz_switch","pid":3965}
183 , local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
184 May 01 00:20:20.435 DEBG registered DTrace probes
185 May 01 00:20:20.435 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
186 May 01 00:20:20.436 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
187 May 01 00:20:20.436 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
188 May 01 00:20:20.436 DEBG registering metric server as a producer
189 May 01 00:20:20.465 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
190 May 01 00:20:20.465 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
191 May 01 00:20:20.465 INFO received request to begin graceful shutdown, local_addr: {"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146) waiting 2.081976416s","v":0,"name":"slog-rs","level":40,"time":"2024-05-01T00:20:20.465716094Z","hostname":"oxz_switch","pid":3965}
192 [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
193 May 01 00:20:22.548 DEBG registered DTrace probes
194 May 01 00:20:22.548 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
195 May 01 00:20:22.548 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
196 May 01 00:20:22.548 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
197 May 01 00:20:22.548 DEBG registering metric server as a producer
198 May 01 00:20:22.577 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
199 May 01 00:20:22.577 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
200 May 01 00:20:22.577 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146) waiting 2.283457718s","v":0,"name":"slog-rs","level":40,"time":"2024-05-01T00:20:22.577911521Z","hostname":"oxz_switch","pid":3965}
201 : dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
202 May 01 00:20:24.862 DEBG registered DTrace probes
203 May 01 00:20:24.863 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
204 May 01 00:20:24.863 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
205 May 01 00:20:24.863 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
206 May 01 00:20:24.863 DEBG registering metric server as a producer
207 May 01 00:20:24.891 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
208 May 01 00:20:24.892 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
209 May 01 00:20:24.892 INFO received request to begin graceful shutdown{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146) waiting 1.882527029s","v":0,"name":"slog-rs","level":40,"time":"2024-05-01T00:20:24.892495114Z","hostname":"oxz_switch","pid":3965}
210 , local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
211 May 01 00:20:26.775 DEBG registered DTrace probes
212 May 01 00:20:26.775 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
213 May 01 00:20:26.776 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
214 May 01 00:20:26.776 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
215 May 01 00:20:26.776 DEBG registering metric server as a producer
216 May 01 00:20:26.805 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
217 May 01 00:20:26.805 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) })
218 May 01 00:20:26.805 INFO received request to begin graceful shutdown, local_addr{"msg":"stats server not created yet, Error registering as metric producer: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146) waiting 2.96582946s","v":0,"name":"slog-rs","level":40,"time":"2024-05-01T00:20:26.805577081Z","hostname":"oxz_switch","pid":3965}
219 : [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266
220 May 01 00:20:29.772 DEBG registered DTrace probes
221 May 01 00:20:29.772 DEBG registered endpoint, path: /collect/{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
222 May 01 00:20:29.772 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:195
223 May 01 00:20:29.772 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
224 May 01 00:20:29.772 DEBG registering metric server as a producer
225 May 01 00:20:29.801 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST
226 May 01 00:20:29.874 DEBG client response, result: Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "33f3b6bc-4d3f-4661-84cc-bfaa99c63f01", "content-length": "41", "date": "Wed, 01 May 2024 00:20:29 GMT"} })
227 May 01 00:20:29.876 INFO received request to begin graceful shutdown, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2d9b906/dropshot/src/server.rs:266