Max level shown:
1 [ Jun 20 21:23:33 Disabled. ]
2 [ Jun 20 21:23:33 Rereading configuration. ]
3 [ Jun 20 21:23:46 Rereading configuration. ]
4 [ Jun 20 21:23:46 Rereading configuration. ]
5 [ Jun 20 21:23:46 Enabled. ]
6 [ Jun 20 21:23:46 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/mg-ddm/pkg/ddm_method_script.sh &"). ]
7 [ Jun 20 21:23:46 Method "start" exited with status 0. ]
82024-06-20T21:23:46.822ZINFOslog-rs: signal handler waiting for context
92024-06-20T21:23:46.840ZINFOslog-rs: signal handler waiting got context
102024-06-20T21:23:46.841ZINFOslog-rs: [tfportrear0_0] sm initialized with addr fe80::50b4:daff:fef2:43f4 on if tfportrear0_0 index 3
112024-06-20T21:23:46.841ZDEBGslog-rs: [tfportrear0_0] starting discovery handler
122024-06-20T21:23:46.842ZINFOslog-rs: admin: listening on [::1]:8000
13 [ Jun 20 21:23:48 Rereading configuration. ]
14 [ Jun 20 21:23:48 Executing refresh method ("/opt/oxide/mg-ddm/pkg/refresh_ctrun_child.sh -c 445"). ]
15 + CONTRACT=''
16 + getopts c: o
17 + CONTRACT=445
18 + getopts c: o
19 + [[ -n 445 ]]
20 + pgrep -c 445
21 + PARENT_PID=4235
22 + [[ -n 4235 ]]
23 + pgrep -P 4235
24 + CHILD_PID=4236
25 + [[ -n 4236 ]]
26 + kill -USR1 4236
272024-06-20T21:23:48.153ZINFOslog-rs: handling smf refresh
28 [ Jun 20 21:23:48 Method "refresh" exited with status 0. ]
292024-06-20T21:23:48.154ZINFOslog-rs: starting stats server on smf refresh
302024-06-20T21:23:48.155ZINFOslog-rs: resolving nexus
312024-06-20T21:23:48.155ZINFOslog-rs: new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53]
322024-06-20T21:23:48.842ZINFOslog-rs: [tfportrear0_0] nbr is fe80::5860:2fff:fece:cdc0@sock server
332024-06-20T21:23:48.842ZDEBGslog-rs: [tfportrear0_0] transition solicit -> exchange
342024-06-20T21:23:48.842ZINFOslog-rs: [tfportrear0_0] exchange: listening on [fe80::50b4:daff:fef2:43f4]:56797
352024-06-20T21:23:48.842ZINFOslog-rs: [tfportrear0_0] waiting for exchange server to start
362024-06-20T21:23:48.844ZINFOslog-rs: [tfportrear0_0] sending 5 routes to dendrite
372024-06-20T21:23:48.844ZDEBGslog-rs: [tfportrear0_0] sending to dpd host=localhost port=12224
382024-06-20T21:23:48.883ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:2:: -> fe80::5860:2fff:fece:cdc0 on port Rear(RearPort(0))/0
392024-06-20T21:23:48.884ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:101:: -> fe80::5860:2fff:fece:cdc0 on port Rear(RearPort(0))/0
402024-06-20T21:23:48.884ZINFOslog-rs: [tfportrear0_0] adding route fdb0:18c0:4d0d:a02a:: -> fe80::5860:2fff:fece:cdc0 on port Rear(RearPort(0))/0
412024-06-20T21:23:48.884ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:3:: -> fe80::5860:2fff:fece:cdc0 on port Rear(RearPort(0))/0
422024-06-20T21:23:48.885ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:1:: -> fe80::5860:2fff:fece:cdc0 on port Rear(RearPort(0))/0
432024-06-20T21:23:48.886ZINFOslog-rs: [tfportrear0_0] removing routes 0 from dendrite
442024-06-20T21:23:48.915ZDEBGslog-rs: [tfportrear0_0] redistributing update to 0 peers
452024-06-20T21:23:49.229ZINFOslog-rs: advertise tunnel: { TunnelOrigin { overlay_prefix: V4( Ipv4Prefix { addr: 0.0.0.0, len: 0, }, ), boundary_addr: fd36:3b21:3616:2cac::1, vni: 99, metric: 18446744073709551615, }, }
462024-06-20T21:23:49.229ZINFOslog-rs: advertise tunnel: { TunnelOrigin { overlay_prefix: V4( Ipv4Prefix { addr: 0.0.0.0, len: 0, }, ), boundary_addr: fd36:3b21:3616:2cac::1, vni: 99, metric: 18446744073709551615, }, }
472024-06-20T21:23:53.157ZWARNslog-rs: resolving nexus failed, no record found for Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } waiting 85.876128ms
482024-06-20T21:23:53.245ZDEBGslog-rs: lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4c9d7efe-dded-4bfd-b6fb-594f5dd61d1c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("65b469d2-6eb7-4e46-8276-ad6d27b67bf9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("8f64d0bd-6f7c-418c-a532-2ff9143ec947.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8f64d0bd-6f7c-418c-a532-2ff9143ec947.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 639, tv_nsec: 808200905 } })
49 Jun 20 21:23:53.247 DEBG registered DTrace probes
50 Jun 20 21:23:53.247 DEBG registered endpoint, path: /{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
51 Jun 20 21:23:53.247 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0560bed/dropshot/src/server.rs:196
52 Jun 20 21:23:53.247 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
53 Jun 20 21:23:53.247 DEBG Nexus IP provided explicitly, will use it, addr: [fd00:1122:3344:101::a]:12221
54 Jun 20 21:23:53.247 DEBG starting producer registration task
55 Jun 20 21:23:53.247 INFO starting oximeter metric producer server, interval: 1s, address: [fd00:1122:3344:101::2]:8001, producer_id: 6bdcfeaf-3a27-40c7-86ba-9159225ea084, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:276
56 Jun 20 21:23:53.247 DEBG registering / renewing oximeter producer lease with Nexus, component: producer-registration-task
57 Jun 20 21:23:53.247 DEBG using nexus address for registration, addr: [fd00:1122:3344:101::a]:12221, component: producer-registration-task
58 Jun 20 21:23:53.277 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
59 Jun 20 21:24:07.882 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
60 Jun 20 21:24:07.883 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out", delay: 218.769639ms, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
61 Jun 20 21:24:08.132 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
62 Jun 20 21:24:23.133 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
63 Jun 20 21:24:23.134 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out", delay: 605.456411ms, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
64 Jun 20 21:24:23.770 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
652024-06-20T21:24:37.172ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
662024-06-20T21:24:39.173ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
67 Jun 20 21:24:39.487 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
68 Jun 20 21:24:39.488 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out", delay: 968.513634ms, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
69 Jun 20 21:24:40.483 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
702024-06-20T21:24:41.174ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
712024-06-20T21:24:43.175ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
722024-06-20T21:24:45.176ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
732024-06-20T21:24:47.177ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
742024-06-20T21:24:49.178ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
752024-06-20T21:24:51.179ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
762024-06-20T21:24:53.180ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
772024-06-20T21:24:55.181ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
78 Jun 20 21:24:55.444 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
79 Jun 20 21:24:55.445 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out", delay: 1.577978383s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
80 Jun 20 21:24:57.049 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
812024-06-20T21:24:57.182ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
822024-06-20T21:24:59.183ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
832024-06-20T21:25:01.184ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
842024-06-20T21:25:03.185ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
852024-06-20T21:25:05.186ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
862024-06-20T21:25:07.187ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
872024-06-20T21:25:09.188ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
882024-06-20T21:25:11.189ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
89 Jun 20 21:25:12.009 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
90 Jun 20 21:25:12.010 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out", delay: 2.558206748s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
912024-06-20T21:25:13.190ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
92 Jun 20 21:25:14.591 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
932024-06-20T21:25:15.191ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
942024-06-20T21:25:17.192ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
952024-06-20T21:25:19.193ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
962024-06-20T21:25:21.195ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
972024-06-20T21:25:23.196ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
982024-06-20T21:25:25.197ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
992024-06-20T21:25:27.198ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1002024-06-20T21:25:29.199ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
101 Jun 20 21:25:29.551 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
102 Jun 20 21:25:29.552 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out", delay: 11.76066324s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
1032024-06-20T21:25:31.200ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1042024-06-20T21:25:33.201ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1052024-06-20T21:25:35.202ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1062024-06-20T21:25:37.203ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1072024-06-20T21:25:39.204ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1082024-06-20T21:25:41.205ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
109 Jun 20 21:25:41.311 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
1102024-06-20T21:25:43.206ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1112024-06-20T21:25:45.207ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1122024-06-20T21:25:47.208ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1132024-06-20T21:25:49.209ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1142024-06-20T21:25:51.210ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1152024-06-20T21:25:53.211ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1162024-06-20T21:25:55.212ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
117 Jun 20 21:25:56.272 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
118 Jun 20 21:25:56.273 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out", delay: 17.268059697s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
1192024-06-20T21:25:57.213ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1202024-06-20T21:25:59.214ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1212024-06-20T21:26:01.215ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1222024-06-20T21:26:03.216ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1232024-06-20T21:26:05.217ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1242024-06-20T21:26:07.218ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1252024-06-20T21:26:09.219ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1262024-06-20T21:26:11.220ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1272024-06-20T21:26:13.221ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
128 Jun 20 21:26:13.525 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
1292024-06-20T21:26:15.222ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1302024-06-20T21:26:17.223ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1312024-06-20T21:26:19.224ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1322024-06-20T21:26:21.225ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1332024-06-20T21:26:23.226ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1342024-06-20T21:26:25.227ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1352024-06-20T21:26:27.228ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
136 Jun 20 21:26:28.485 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
137 Jun 20 21:26:28.486 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out", delay: 35.557089896s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
1382024-06-20T21:26:29.229ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1392024-06-20T21:26:31.230ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1402024-06-20T21:26:33.231ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1412024-06-20T21:26:35.232ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1422024-06-20T21:26:37.233ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1432024-06-20T21:26:39.234ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1442024-06-20T21:26:41.235ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1452024-06-20T21:26:43.236ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1462024-06-20T21:26:45.237ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1472024-06-20T21:26:47.238ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1482024-06-20T21:26:49.239ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1492024-06-20T21:26:51.240ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1502024-06-20T21:26:53.241ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1512024-06-20T21:26:55.242ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1522024-06-20T21:26:57.243ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1532024-06-20T21:26:59.244ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1542024-06-20T21:27:01.246ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1552024-06-20T21:27:03.247ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
156 Jun 20 21:27:03.977 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
1572024-06-20T21:27:05.248ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1582024-06-20T21:27:07.249ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1592024-06-20T21:27:09.250ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1602024-06-20T21:27:11.251ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1612024-06-20T21:27:13.252ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1622024-06-20T21:27:15.253ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1632024-06-20T21:27:17.254ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
164 Jun 20 21:27:18.937 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
165 Jun 20 21:27:18.939 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out", delay: 68.068370897s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
1662024-06-20T21:27:19.255ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1672024-06-20T21:27:21.256ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1682024-06-20T21:27:23.257ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1692024-06-20T21:27:25.258ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1702024-06-20T21:27:27.259ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1712024-06-20T21:27:29.272ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1722024-06-20T21:28:12.201ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
1732024-06-20T21:28:16.232ZWARNslog-rs: [tfportrear0_0] neighbor sock@fe80::5860:2fff:fece:cdc0 missed solicit interval
174 Jun 20 21:28:27.049 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::a]:12221/metrics/producers, method: POST, component: producer-registration-task
175 Jun 20 21:28:42.050 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
176 Jun 20 21:28:42.054 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out", delay: 178.091766715s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417