Max level shown:
1 [ Aug 2 04:40:17 Disabled. ]
2 [ Aug 2 04:40:17 Rereading configuration. ]
3 [ Aug 2 04:40:18 Enabled. ]
4 [ Aug 2 04:40:18 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/mg-ddm/pkg/ddm_method_script.sh &"). ]
5 [ Aug 2 04:40:18 Method "start" exited with status 0. ]
6 [ Aug 2 04:40:18 Rereading configuration. ]
7 [ Aug 2 04:40:18 Executing refresh method ("/opt/oxide/mg-ddm/pkg/refresh_ctrun_child.sh -c 215"). ]
8 + CONTRACT=''
9 + getopts c: o
10 + CONTRACT=215
11 + getopts c: o
12 + [[ -n 215 ]]
13 + pgrep -c 215
14 + PARENT_PID=2270
15 + [[ -n 2270 ]]
16 + pgrep -P 2270
17 + CHILD_PID=2272
18 + [[ -n 2272 ]]
19 + kill -USR1 2272
20 [ Aug 2 04:40:18 Method "refresh" exited with status 0. ]
21 [ Aug 2 04:40:18 Stopping because all processes in service exited. ]
22 [ Aug 2 04:40:18 Executing stop method (:kill). ]
23 [ Aug 2 04:40:18 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/mg-ddm/pkg/ddm_method_script.sh &"). ]
24 [ Aug 2 04:40:18 Method "start" exited with status 0. ]
252024-08-02T04:40:18.225ZINFOslog-rs: signal handler waiting for context
262024-08-02T04:40:18.245ZINFOslog-rs: signal handler waiting got context
272024-08-02T04:40:18.246ZWARNslog-rs: [] failed to get IPv6 address for interface tfportrear0_0/ll: not found: tfportrear0_0/ll
282024-08-02T04:40:18.246ZINFOslog-rs: admin: listening on [::1]:8000
292024-08-02T04:40:19.246ZWARNslog-rs: [] failed to get IPv6 address for interface tfportrear0_0/ll: not found: tfportrear0_0/ll
302024-08-02T04:40:20.246ZWARNslog-rs: [] failed to get IPv6 address for interface tfportrear0_0/ll: not found: tfportrear0_0/ll
312024-08-02T04:40:21.246ZWARNslog-rs: [] failed to get IPv6 address for interface tfportrear0_0/ll: not found: tfportrear0_0/ll
322024-08-02T04:40:22.246ZWARNslog-rs: [] failed to get IPv6 address for interface tfportrear0_0/ll: not found: tfportrear0_0/ll
332024-08-02T04:40:23.246ZWARNslog-rs: [] failed to get IPv6 address for interface tfportrear0_0/ll: not found: tfportrear0_0/ll
342024-08-02T04:40:24.246ZWARNslog-rs: [] failed to get IPv6 address for interface tfportrear0_0/ll: not found: tfportrear0_0/ll
352024-08-02T04:40:25.247ZWARNslog-rs: [] failed to get IPv6 address for interface tfportrear0_0/ll: not found: tfportrear0_0/ll
362024-08-02T04:40:26.247ZWARNslog-rs: [] failed to get IPv6 address for interface tfportrear0_0/ll: not found: tfportrear0_0/ll
372024-08-02T04:40:27.247ZWARNslog-rs: [] failed to get IPv6 address for interface tfportrear0_0/ll: not found: tfportrear0_0/ll
382024-08-02T04:40:28.247ZWARNslog-rs: [] failed to get IPv6 address for interface tfportrear0_0/ll: not found: tfportrear0_0/ll
392024-08-02T04:40:29.247ZINFOslog-rs: [tfportrear0_0] sm initialized with addr fe80::41b:50ff:fe80:2ddb on if tfportrear0_0 index 3
402024-08-02T04:40:29.247ZDEBGslog-rs: [tfportrear0_0] starting discovery handler
41 [ Aug 2 04:40:29 Rereading configuration. ]
42 [ Aug 2 04:40:29 Executing refresh method ("/opt/oxide/mg-ddm/pkg/refresh_ctrun_child.sh -c 219"). ]
43 + CONTRACT=''
44 + getopts c: o
45 + CONTRACT=219
46 + getopts c: o
47 + [[ -n 219 ]]
48 + pgrep -c 219
49 + PARENT_PID=2292
50 + [[ -n 2292 ]]
51 + pgrep -P 2292
52 + CHILD_PID=2293
53 + [[ -n 2293 ]]
54 + kill -USR1 2293
552024-08-02T04:40:29.555ZINFOslog-rs: handling smf refresh
56 [ Aug 2 04:40:29 Method "refresh" exited with status 0. ]
572024-08-02T04:40:29.557ZINFOslog-rs: starting stats server on smf refresh
582024-08-02T04:40:29.558ZINFOslog-rs: resolving nexus
592024-08-02T04:40:29.558ZINFOslog-rs: new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53]
602024-08-02T04:40:30.938ZWARNslog-rs: [tfportrear0_0] admin event in solicit state: Announce(Underlay({Ipv6Net { addr: fd84:4e06:748a:fae1::1, width: 64 }}))
612024-08-02T04:40:30.938ZINFOslog-rs: advertise tunnel: { TunnelOrigin { overlay_prefix: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), boundary_addr: fd84:4e06:748a:fae1::1, vni: 99, metric: 18446744073709551615, }, }
622024-08-02T04:40:30.938ZWARNslog-rs: [tfportrear0_0] admin event in solicit state: Announce(Tunnel({TunnelOrigin { overlay_prefix: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), boundary_addr: fd84:4e06:748a:fae1::1, vni: 99, metric: 18446744073709551615 }}))
632024-08-02T04:40:30.939ZINFOslog-rs: advertise tunnel: { TunnelOrigin { overlay_prefix: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), boundary_addr: fd84:4e06:748a:fae1::1, vni: 99, metric: 18446744073709551615, }, }
642024-08-02T04:40:30.939ZWARNslog-rs: [tfportrear0_0] admin event in solicit state: Announce(Tunnel({TunnelOrigin { overlay_prefix: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), boundary_addr: fd84:4e06:748a:fae1::1, vni: 99, metric: 18446744073709551615 }}))
652024-08-02T04:40:31.248ZINFOslog-rs: [tfportrear0_0] nbr is fe80::20e1:e5ff:fef5:fc37@buskin server
662024-08-02T04:40:31.248ZDEBGslog-rs: [tfportrear0_0] transition solicit -> exchange
672024-08-02T04:40:31.248ZINFOslog-rs: [tfportrear0_0] exchange: listening on [fe80::41b:50ff:fe80:2ddb]:56797
682024-08-02T04:40:31.248ZINFOslog-rs: [tfportrear0_0] waiting for exchange server to start
692024-08-02T04:40:31.250ZINFOslog-rs: [tfportrear0_0] sending 5 routes to dendrite
702024-08-02T04:40:31.250ZDEBGslog-rs: [tfportrear0_0] sending to dpd host=localhost port=12224
712024-08-02T04:40:31.289ZINFOslog-rs: [tfportrear0_0] adding route fdb0:18c0:4d0d:9fb2:: -> fe80::20e1:e5ff:fef5:fc37 on port Rear(RearPort(0))/0
722024-08-02T04:40:31.290ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:101:: -> fe80::20e1:e5ff:fef5:fc37 on port Rear(RearPort(0))/0
732024-08-02T04:40:31.290ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:1:: -> fe80::20e1:e5ff:fef5:fc37 on port Rear(RearPort(0))/0
742024-08-02T04:40:31.290ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:2:: -> fe80::20e1:e5ff:fef5:fc37 on port Rear(RearPort(0))/0
752024-08-02T04:40:31.291ZINFOslog-rs: [tfportrear0_0] adding route fd00:1122:3344:3:: -> fe80::20e1:e5ff:fef5:fc37 on port Rear(RearPort(0))/0
762024-08-02T04:40:31.292ZINFOslog-rs: [tfportrear0_0] removing routes 0 from dendrite
772024-08-02T04:40:31.321ZDEBGslog-rs: [tfportrear0_0] redistributing update to 0 peers
782024-08-02T04:40:34.561ZDEBGslog-rs: lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("38431a75-b2a9-4fdf-a438-6ea7c2ca66ea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("449fd4e3-7ead-449f-b1f6-5c1688eae3b4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("70b9d0e5-8c43-4cff-94e0-c285984b5a48.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("70b9d0e5-8c43-4cff-94e0-c285984b5a48.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::c)) }], valid_until: Instant { tv_sec: 685, tv_nsec: 254325877 } })
79 Aug 02 04:40:34.562 DEBG registered DTrace probes
80 Aug 02 04:40:34.562 DEBG registered endpoint, path: /{producer_id}, method: GET, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
81 Aug 02 04:40:34.562 INFO listening, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot, file: /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0560bed/dropshot/src/server.rs:196
82 Aug 02 04:40:34.562 DEBG successfully registered DTrace USDT probes, local_addr: [fd00:1122:3344:101::2]:8001, component: dropshot
83 Aug 02 04:40:34.563 DEBG Nexus IP provided explicitly, will use it, addr: [fd00:1122:3344:101::b]:12221
84 Aug 02 04:40:34.563 DEBG starting producer registration task
85 Aug 02 04:40:34.563 INFO starting oximeter metric producer server, interval: 1s, address: [fd00:1122:3344:101::2]:8001, producer_id: 37ce63af-3247-46a5-84db-8e89690a047d, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:276
86 Aug 02 04:40:34.563 DEBG registering / renewing oximeter producer lease with Nexus, component: producer-registration-task
87 Aug 02 04:40:34.563 DEBG using nexus address for registration, addr: [fd00:1122:3344:101::b]:12221, component: producer-registration-task
88 Aug 02 04:40:34.593 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::b]:12221/metrics/producers, method: POST, component: producer-registration-task
892024-08-02T04:40:46.945ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
902024-08-02T04:40:48.946ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
91 Aug 02 04:40:49.280 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
92 Aug 02 04:40:49.281 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out", delay: 331.116059ms, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
93 Aug 02 04:40:49.642 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::b]:12221/metrics/producers, method: POST, component: producer-registration-task
942024-08-02T04:40:50.947ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
952024-08-02T04:40:52.948ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
962024-08-02T04:40:54.949ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
972024-08-02T04:40:56.950ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
982024-08-02T04:40:58.951ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
992024-08-02T04:41:00.952ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1002024-08-02T04:41:02.953ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
101 Aug 02 04:41:04.603 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
102 Aug 02 04:41:04.604 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out", delay: 682.46935ms, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
1032024-08-02T04:41:04.954ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
104 Aug 02 04:41:05.315 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::b]:12221/metrics/producers, method: POST, component: producer-registration-task
1052024-08-02T04:41:06.956ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1062024-08-02T04:41:08.957ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1072024-08-02T04:41:10.958ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1082024-08-02T04:41:12.959ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1092024-08-02T04:41:14.960ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1102024-08-02T04:41:16.961ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1112024-08-02T04:41:18.962ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
112 Aug 02 04:41:20.275 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
113 Aug 02 04:41:20.276 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out", delay: 1.070846291s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
1142024-08-02T04:41:20.963ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
115 Aug 02 04:41:21.375 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::b]:12221/metrics/producers, method: POST, component: producer-registration-task
1162024-08-02T04:41:22.964ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1172024-08-02T04:41:24.965ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1182024-08-02T04:41:26.966ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1192024-08-02T04:41:28.967ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1202024-08-02T04:41:30.968ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1212024-08-02T04:41:32.969ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1222024-08-02T04:41:34.970ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
123 Aug 02 04:41:36.336 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
124 Aug 02 04:41:36.337 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out", delay: 2.267845098s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
1252024-08-02T04:41:36.971ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
126 Aug 02 04:41:38.630 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::b]:12221/metrics/producers, method: POST, component: producer-registration-task
1272024-08-02T04:41:38.972ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1282024-08-02T04:41:40.973ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1292024-08-02T04:41:42.974ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1302024-08-02T04:41:44.975ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1312024-08-02T04:41:46.976ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1322024-08-02T04:41:48.977ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1332024-08-02T04:41:50.978ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1342024-08-02T04:41:52.979ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
135 Aug 02 04:41:53.591 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
136 Aug 02 04:41:53.592 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out", delay: 5.344658471s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
1372024-08-02T04:41:54.980ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1382024-08-02T04:41:56.981ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
139 Aug 02 04:41:58.954 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::b]:12221/metrics/producers, method: POST, component: producer-registration-task
1402024-08-02T04:41:58.982ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1412024-08-02T04:42:00.983ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1422024-08-02T04:42:02.984ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1432024-08-02T04:42:04.985ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1442024-08-02T04:42:06.986ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1452024-08-02T04:42:08.987ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1462024-08-02T04:42:10.988ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1472024-08-02T04:42:12.989ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
148 Aug 02 04:42:13.914 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
149 Aug 02 04:42:13.915 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out", delay: 6.882143874s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
1502024-08-02T04:42:14.990ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1512024-08-02T04:42:16.991ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1522024-08-02T04:42:18.992ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
153 Aug 02 04:42:20.809 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::b]:12221/metrics/producers, method: POST, component: producer-registration-task
1542024-08-02T04:42:20.993ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1552024-08-02T04:42:22.994ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1562024-08-02T04:42:24.995ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1572024-08-02T04:42:26.996ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1582024-08-02T04:42:28.997ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1592024-08-02T04:42:30.998ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1602024-08-02T04:42:32.999ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1612024-08-02T04:42:35.000ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
162 Aug 02 04:42:35.769 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
163 Aug 02 04:42:35.771 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out", delay: 20.194415252s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
1642024-08-02T04:42:37.001ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1652024-08-02T04:42:39.002ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1662024-08-02T04:42:41.003ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1672024-08-02T04:42:43.004ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1682024-08-02T04:42:45.005ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1692024-08-02T04:42:47.006ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1702024-08-02T04:42:49.007ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1712024-08-02T04:42:51.008ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1722024-08-02T04:42:53.009ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1732024-08-02T04:42:55.010ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
174 Aug 02 04:42:55.941 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::b]:12221/metrics/producers, method: POST, component: producer-registration-task
1752024-08-02T04:42:57.011ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1762024-08-02T04:42:59.012ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1772024-08-02T04:43:01.013ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1782024-08-02T04:43:03.014ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1792024-08-02T04:43:05.015ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1802024-08-02T04:43:07.017ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1812024-08-02T04:43:09.018ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
182 Aug 02 04:43:10.902 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
183 Aug 02 04:43:10.903 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out", delay: 43.197286958s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
1842024-08-02T04:43:11.019ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1852024-08-02T04:43:13.020ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1862024-08-02T04:43:15.021ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1872024-08-02T04:43:17.022ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1882024-08-02T04:43:19.022ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
189 Aug 02 04:43:54.108 DEBG client request, body: Some(Body), uri: http://[fd00:1122:3344:101::b]:12221/metrics/producers, method: POST, component: producer-registration-task
190 Aug 02 04:44:09.110 DEBG client response, result: Err(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, source: TimedOut }), component: producer-registration-task
191 Aug 02 04:44:09.111 WARN failed to register as a producer with Nexus, will retry, error: "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers): operation timed out", delay: 60.794784742s, component: producer-registration-task, file: /home/build/.cargo/git/checkouts/omicron-d039c41f152bda83/450f906/oximeter/producer/src/lib.rs:417
1922024-08-02T04:44:14.009ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval
1932024-08-02T04:44:16.235ZWARNslog-rs: [tfportrear0_0] neighbor buskin@fe80::20e1:e5ff:fef5:fc37 missed solicit interval