Max level shown:
1 [ Dec 11 18:12:24 Enabled. ]
2 [ Dec 11 18:12:24 Rereading configuration. ]
3 [ Dec 11 18:12:25 Rereading configuration. ]
4 [ Dec 11 18:12:37 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Dec 11 18:12:37 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72025-12-11T18:12:37.045ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82025-12-11T18:12:37.086ZINFOtfportd: connected to dpd running softnpu-606c0be8
92025-12-11T18:12:37.086ZINFOtfportd: running in sync-only mode
102025-12-11T18:12:37.087ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112025-12-11T18:12:37.089ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132025-12-11T18:12:37.090ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( f89c404a-9473-4775-8021-4f5f083dc013, ), sled_id: Some( 44912f4c-337d-4629-96f9-aeb95ba5e20c, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
142025-12-11T18:12:37.090ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152025-12-11T18:12:37.095ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::7cbb:57ff:fe6a:171->7e:bb:57:6a:01:71 interface = tfportrear0_0
162025-12-11T18:12:37.096ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172025-12-11T18:12:37.100ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
182025-12-11T18:12:37.105ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ Dec 11 18:12:37 Rereading configuration. ]
20 [ Dec 11 18:12:37 Executing refresh method (:kill). ]
21 [ Dec 11 18:12:37 Stopping because all processes in service exited. ]
22 [ Dec 11 18:12:37 Executing stop method (:kill). ]
23 [ Dec 11 18:12:37 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ Dec 11 18:12:37 Method "start" exited with status 0. ]
252025-12-11T18:12:37.709ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262025-12-11T18:12:37.748ZINFOtfportd: connected to dpd running softnpu-606c0be8
272025-12-11T18:12:37.749ZINFOtfportd: running in sync-only mode
282025-12-11T18:12:37.749ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292025-12-11T18:12:37.750ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
302025-12-11T18:12:37.750ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: f89c404a-9473-4775-8021-4f5f083dc013, sled_id: 44912f4c-337d-4629-96f9-aeb95ba5e20c, model: "i86pc", revision: 0, serial: "sock" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, lot: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 608acea2-b346-4a31-9b97-1419be91b2c3, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
312025-12-11T18:12:37.751ZDEBGtfportd: created producer ID producer_id = dc87a1a4-1448-4b6d-8d4f-f5ffed0990dc unit = oximeter
322025-12-11T18:12:37.752ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( f89c404a-9473-4775-8021-4f5f083dc013, ), sled_id: Some( 44912f4c-337d-4629-96f9-aeb95ba5e20c, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
332025-12-11T18:12:37.759ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
342025-12-11T18:12:37.760ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::7cbb:57ff:fe6a:171->7e:bb:57:6a:01:71 interface = tfportrear0_0
352025-12-11T18:12:37.760ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::d4c4:3bff:feed:53e2->d6:c4:3b:ed:53:e2 interface = tfportrear0_0
362025-12-11T18:12:37.761ZDEBGtfportd: registered DTrace probes unit = producer-server
372025-12-11T18:12:37.763ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:55595 method = GET path = /{producer_id} unit = producer-server versions = all
382025-12-11T18:12:37.763ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.4/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:55595 unit = producer-server
392025-12-11T18:12:37.763ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:55595 unit = producer-server
402025-12-11T18:12:37.763ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:55595 unit = producer-server
412025-12-11T18:12:37.763ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
422025-12-11T18:12:37.763ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
432025-12-11T18:12:37.763ZDEBGtfportd: starting producer registration task unit = producer-server
442025-12-11T18:12:37.763ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:55595 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = dc87a1a4-1448-4b6d-8d4f-f5ffed0990dc unit = producer-server
452025-12-11T18:12:37.763ZINFOtfportd: created oximeter producer server unit = oximeter
462025-12-11T18:12:37.764ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
472025-12-11T18:12:37.764ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
482025-12-11T18:12:37.765ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
492025-12-11T18:12:37.765ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2025-12-11T18:12:20.959853846Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
502025-12-11T18:12:37.765ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 3087544612047472304 unit = oximeter
512025-12-11T18:12:37.765ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
522025-12-11T18:12:37.767ZWARNtfportd: tfportqsfp0_0 has no addrs
532025-12-11T18:12:39.008ZINFOtfportd: added new ARP entry entry = 10.151.2.174->3a:ff:57:2a:fb:d1 interface = tfportqsfp0_0
542025-12-11T18:12:39.094ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
552025-12-11T18:12:39.098ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
562025-12-11T18:12:39.101ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
572025-12-11T18:12:39.101ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
582025-12-11T18:12:39.103ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2025-12-11T18:12:20.959716963Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
592025-12-11T18:12:39.103ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 18269215159268482856 unit = oximeter
602025-12-11T18:12:39.103ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
612025-12-11T18:12:39.732ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
622025-12-11T18:12:39.737ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
632025-12-11T18:12:39.740ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
642025-12-11T18:12:40.758ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
652025-12-11T18:12:40.767ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
662025-12-11T18:12:40.770ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
672025-12-11T18:12:42.178ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
682025-12-11T18:12:42.183ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
692025-12-11T18:12:42.186ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
702025-12-11T18:12:42.764ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
712025-12-11T18:12:42.767ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("34187f2f-4826-4991-99b3-2a4ff2992a14.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4ef6e9fe-b880-4221-9db8-d5a1ad5faef5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("fd5f29f9-5ef8-4d2d-bf35-86062269b1e1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("fd5f29f9-5ef8-4d2d-bf35-86062269b1e1.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 1675, tv_nsec: 850925054 } }) unit = producer-server
722025-12-11T18:12:42.768ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
732025-12-11T18:12:42.802ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
742025-12-11T18:12:42.803ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
752025-12-11T18:12:42.807ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
762025-12-11T18:12:44.009ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
772025-12-11T18:12:44.014ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
782025-12-11T18:12:44.017ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
792025-12-11T18:12:45.407ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
802025-12-11T18:12:45.412ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
812025-12-11T18:12:45.416ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
822025-12-11T18:12:46.277ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
832025-12-11T18:12:46.281ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
842025-12-11T18:12:46.284ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
852025-12-11T18:12:47.530ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
862025-12-11T18:12:47.535ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
872025-12-11T18:12:47.538ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
882025-12-11T18:12:47.769ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3087544612047472304 n_samples = 6 unit = oximeter
892025-12-11T18:12:48.389ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
902025-12-11T18:12:48.394ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
912025-12-11T18:12:48.397ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
922025-12-11T18:12:49.105ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18269215159268482856 n_samples = 6 unit = oximeter
932025-12-11T18:12:49.870ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
942025-12-11T18:12:49.875ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
952025-12-11T18:12:49.878ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
962025-12-11T18:12:51.282ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
972025-12-11T18:12:51.288ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
982025-12-11T18:12:51.291ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
992025-12-11T18:12:52.609ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1002025-12-11T18:12:52.614ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1012025-12-11T18:12:52.617ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1022025-12-11T18:12:53.443ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1032025-12-11T18:12:53.447ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1042025-12-11T18:12:53.450ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1052025-12-11T18:12:54.536ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1062025-12-11T18:12:54.541ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1072025-12-11T18:12:54.544ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1082025-12-11T18:12:55.548ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1092025-12-11T18:12:55.553ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1102025-12-11T18:12:55.556ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1112025-12-11T18:12:56.875ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1122025-12-11T18:12:56.879ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1132025-12-11T18:12:56.883ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1142025-12-11T18:12:57.585ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1152025-12-11T18:12:57.589ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1162025-12-11T18:12:57.592ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1172025-12-11T18:12:57.773ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3087544612047472304 n_samples = 6 unit = oximeter
1182025-12-11T18:12:57.806ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1192025-12-11T18:12:57.807ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 20.041349684s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
1202025-12-11T18:12:58.051ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("34187f2f-4826-4991-99b3-2a4ff2992a14.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4ef6e9fe-b880-4221-9db8-d5a1ad5faef5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("fd5f29f9-5ef8-4d2d-bf35-86062269b1e1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("fd5f29f9-5ef8-4d2d-bf35-86062269b1e1.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 1691, tv_nsec: 133110466 } }) unit = producer-server
1212025-12-11T18:12:58.052ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
1222025-12-11T18:12:58.083ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
1232025-12-11T18:12:58.991ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1242025-12-11T18:12:58.997ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1252025-12-11T18:12:59.000ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1262025-12-11T18:12:59.113ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18269215159268482856 n_samples = 6 unit = oximeter
1272025-12-11T18:13:00.148ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1282025-12-11T18:13:00.152ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1292025-12-11T18:13:00.155ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1302025-12-11T18:13:01.175ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1312025-12-11T18:13:01.180ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1322025-12-11T18:13:01.183ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1332025-12-11T18:13:01.825ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1342025-12-11T18:13:01.829ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1352025-12-11T18:13:01.832ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1362025-12-11T18:13:02.946ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1372025-12-11T18:13:02.955ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1382025-12-11T18:13:02.960ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1392025-12-11T18:13:03.735ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1402025-12-11T18:13:03.741ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1412025-12-11T18:13:03.744ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1422025-12-11T18:13:04.543ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1432025-12-11T18:13:04.548ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1442025-12-11T18:13:04.552ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1452025-12-11T18:13:05.392ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1462025-12-11T18:13:05.416ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1472025-12-11T18:13:05.427ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1482025-12-11T18:13:06.554ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1492025-12-11T18:13:06.572ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1502025-12-11T18:13:06.579ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1512025-12-11T18:13:08.255ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3087544612047472304 n_samples = 6 unit = oximeter
1522025-12-11T18:13:08.264ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1532025-12-11T18:13:08.272ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1542025-12-11T18:13:08.276ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1552025-12-11T18:13:09.144ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18269215159268482856 n_samples = 6 unit = oximeter
1562025-12-11T18:13:09.489ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1572025-12-11T18:13:09.495ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1582025-12-11T18:13:09.500ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1592025-12-11T18:13:10.799ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1602025-12-11T18:13:10.806ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1612025-12-11T18:13:10.810ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1622025-12-11T18:13:12.081ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1632025-12-11T18:13:12.085ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1642025-12-11T18:13:12.089ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1652025-12-11T18:13:13.126ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1662025-12-11T18:13:13.127ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 35.319087037s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
1672025-12-11T18:13:13.354ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1682025-12-11T18:13:13.359ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1692025-12-11T18:13:13.362ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1702025-12-11T18:13:13.727ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("34187f2f-4826-4991-99b3-2a4ff2992a14.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4ef6e9fe-b880-4221-9db8-d5a1ad5faef5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("fd5f29f9-5ef8-4d2d-bf35-86062269b1e1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("fd5f29f9-5ef8-4d2d-bf35-86062269b1e1.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 1706, tv_nsec: 764112619 } }) unit = producer-server
1712025-12-11T18:13:13.728ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
1722025-12-11T18:13:13.768ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
1732025-12-11T18:13:14.847ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1742025-12-11T18:13:14.852ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1752025-12-11T18:13:14.860ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1762025-12-11T18:13:16.221ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1772025-12-11T18:13:16.228ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1782025-12-11T18:13:16.232ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1792025-12-11T18:13:17.264ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1802025-12-11T18:13:17.269ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1812025-12-11T18:13:17.272ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1822025-12-11T18:13:18.007ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1832025-12-11T18:13:18.012ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1842025-12-11T18:13:18.015ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1852025-12-11T18:13:18.284ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3087544612047472304 n_samples = 6 unit = oximeter
1862025-12-11T18:13:19.172ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18269215159268482856 n_samples = 6 unit = oximeter
1872025-12-11T18:13:19.465ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1882025-12-11T18:13:19.470ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1892025-12-11T18:13:19.473ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1902025-12-11T18:13:20.281ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1912025-12-11T18:13:20.286ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1922025-12-11T18:13:20.289ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1932025-12-11T18:13:21.372ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1942025-12-11T18:13:21.378ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1952025-12-11T18:13:21.380ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1962025-12-11T18:13:22.527ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1972025-12-11T18:13:22.532ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
1982025-12-11T18:13:22.535ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1992025-12-11T18:13:26.547ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2002025-12-11T18:13:26.809ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2012025-12-11T18:13:26.814ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2022025-12-11T18:13:27.820ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2032025-12-11T18:13:27.827ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2042025-12-11T18:13:27.831ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2052025-12-11T18:13:28.299ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3087544612047472304 n_samples = 6 unit = oximeter
2062025-12-11T18:13:28.794ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2072025-12-11T18:13:28.795ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 50.96781106s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
2082025-12-11T18:13:29.120ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2092025-12-11T18:13:29.128ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2102025-12-11T18:13:29.131ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2112025-12-11T18:13:29.178ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18269215159268482856 n_samples = 6 unit = oximeter
2122025-12-11T18:13:29.648ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("34187f2f-4826-4991-99b3-2a4ff2992a14.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4ef6e9fe-b880-4221-9db8-d5a1ad5faef5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("fd5f29f9-5ef8-4d2d-bf35-86062269b1e1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("fd5f29f9-5ef8-4d2d-bf35-86062269b1e1.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 1722, tv_nsec: 667716508 } }) unit = producer-server
2132025-12-11T18:13:29.650ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
2142025-12-11T18:13:29.728ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
2152025-12-11T18:13:29.761ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2162025-12-11T18:13:29.768ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2172025-12-11T18:13:29.772ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2182025-12-11T18:13:30.439ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2192025-12-11T18:13:30.446ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2202025-12-11T18:13:30.451ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2212025-12-11T18:13:31.744ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2222025-12-11T18:13:31.749ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2232025-12-11T18:13:31.752ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2242025-12-11T18:13:32.401ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2252025-12-11T18:13:32.406ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2262025-12-11T18:13:32.408ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2272025-12-11T18:13:33.109ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2282025-12-11T18:13:33.114ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2292025-12-11T18:13:33.117ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2302025-12-11T18:13:34.408ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2312025-12-11T18:13:34.414ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2322025-12-11T18:13:34.418ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2332025-12-11T18:13:35.442ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2342025-12-11T18:13:35.447ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2352025-12-11T18:13:35.450ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2362025-12-11T18:13:36.016ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2372025-12-11T18:13:36.021ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2382025-12-11T18:13:36.024ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2392025-12-11T18:13:37.129ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2402025-12-11T18:13:37.135ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2412025-12-11T18:13:37.138ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2422025-12-11T18:13:37.694ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2432025-12-11T18:13:37.699ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2442025-12-11T18:13:37.703ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2452025-12-11T18:13:38.301ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3087544612047472304 n_samples = 6 unit = oximeter
2462025-12-11T18:13:38.495ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2472025-12-11T18:13:38.500ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2482025-12-11T18:13:38.504ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2492025-12-11T18:13:39.182ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18269215159268482856 n_samples = 6 unit = oximeter
2502025-12-11T18:13:39.538ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2512025-12-11T18:13:39.544ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2522025-12-11T18:13:39.547ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2532025-12-11T18:13:40.837ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2542025-12-11T18:13:40.842ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2552025-12-11T18:13:40.845ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2562025-12-11T18:13:41.526ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2572025-12-11T18:13:41.533ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2582025-12-11T18:13:41.536ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2592025-12-11T18:13:42.420ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2602025-12-11T18:13:42.426ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2612025-12-11T18:13:42.428ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2622025-12-11T18:13:43.383ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2632025-12-11T18:13:43.389ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2642025-12-11T18:13:43.392ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2652025-12-11T18:13:44.729ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2662025-12-11T18:13:44.730ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 66.902355494s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
2672025-12-11T18:13:44.819ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2682025-12-11T18:13:44.824ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2692025-12-11T18:13:44.827ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2702025-12-11T18:13:45.529ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2712025-12-11T18:13:45.535ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2722025-12-11T18:13:45.538ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2732025-12-11T18:13:46.110ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("34187f2f-4826-4991-99b3-2a4ff2992a14.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4ef6e9fe-b880-4221-9db8-d5a1ad5faef5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("fd5f29f9-5ef8-4d2d-bf35-86062269b1e1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("fd5f29f9-5ef8-4d2d-bf35-86062269b1e1.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 1739, tv_nsec: 130345373 } }) unit = producer-server
2742025-12-11T18:13:46.110ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
2752025-12-11T18:13:46.140ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
2762025-12-11T18:13:46.212ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2772025-12-11T18:13:46.218ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2782025-12-11T18:13:46.221ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2792025-12-11T18:13:47.363ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2802025-12-11T18:13:47.368ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2812025-12-11T18:13:47.372ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2822025-12-11T18:13:48.303ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3087544612047472304 n_samples = 6 unit = oximeter
2832025-12-11T18:13:48.564ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2842025-12-11T18:13:48.570ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2852025-12-11T18:13:48.573ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2862025-12-11T18:13:49.184ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18269215159268482856 n_samples = 6 unit = oximeter
2872025-12-11T18:13:49.864ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2882025-12-11T18:13:49.870ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2892025-12-11T18:13:49.873ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2902025-12-11T18:13:50.808ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2912025-12-11T18:13:50.813ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2922025-12-11T18:13:50.816ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2932025-12-11T18:13:51.656ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2942025-12-11T18:13:51.665ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2952025-12-11T18:13:51.669ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2962025-12-11T18:13:52.343ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2972025-12-11T18:13:52.349ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
2982025-12-11T18:13:52.352ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2992025-12-11T18:13:53.440ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3002025-12-11T18:13:53.446ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3012025-12-11T18:13:53.452ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3022025-12-11T18:13:54.066ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3032025-12-11T18:13:54.077ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3042025-12-11T18:13:54.085ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3052025-12-11T18:13:55.531ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3062025-12-11T18:13:55.601ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3072025-12-11T18:13:55.769ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3082025-12-11T18:13:57.283ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3092025-12-11T18:13:57.291ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3102025-12-11T18:13:57.295ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3112025-12-11T18:13:58.221ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3122025-12-11T18:13:58.228ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3132025-12-11T18:13:58.233ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3142025-12-11T18:13:58.383ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3087544612047472304 n_samples = 6 unit = oximeter
3152025-12-11T18:13:58.973ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3162025-12-11T18:13:58.981ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3172025-12-11T18:13:58.985ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3182025-12-11T18:13:59.192ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18269215159268482856 n_samples = 6 unit = oximeter
3192025-12-11T18:13:59.521ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3202025-12-11T18:13:59.528ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3212025-12-11T18:13:59.532ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3222025-12-11T18:14:00.148ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3232025-12-11T18:14:00.157ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3242025-12-11T18:14:00.162ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3252025-12-11T18:14:01.002ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3262025-12-11T18:14:01.009ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3272025-12-11T18:14:01.015ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3282025-12-11T18:14:01.142ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3292025-12-11T18:14:01.166ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 83.338844921s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
3302025-12-11T18:14:02.213ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3312025-12-11T18:14:02.219ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3322025-12-11T18:14:02.222ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3332025-12-11T18:14:03.166ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3342025-12-11T18:14:03.174ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3352025-12-11T18:14:03.177ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3362025-12-11T18:14:04.208ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("34187f2f-4826-4991-99b3-2a4ff2992a14.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4ef6e9fe-b880-4221-9db8-d5a1ad5faef5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("fd5f29f9-5ef8-4d2d-bf35-86062269b1e1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("fd5f29f9-5ef8-4d2d-bf35-86062269b1e1.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 1757, tv_nsec: 228540144 } }) unit = producer-server
3372025-12-11T18:14:04.209ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
3382025-12-11T18:14:04.281ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
3392025-12-11T18:14:04.609ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3402025-12-11T18:14:04.622ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3412025-12-11T18:14:04.840ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3422025-12-11T18:14:05.406ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3432025-12-11T18:14:05.412ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3442025-12-11T18:14:05.415ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3452025-12-11T18:14:06.581ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3462025-12-11T18:14:06.586ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3472025-12-11T18:14:06.605ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3482025-12-11T18:14:07.826ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3492025-12-11T18:14:07.832ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3502025-12-11T18:14:07.835ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3512025-12-11T18:14:08.387ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3087544612047472304 n_samples = 6 unit = oximeter
3522025-12-11T18:14:09.011ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3532025-12-11T18:14:09.016ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3542025-12-11T18:14:09.019ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3552025-12-11T18:14:09.194ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18269215159268482856 n_samples = 6 unit = oximeter
3562025-12-11T18:14:09.806ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3572025-12-11T18:14:09.812ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3582025-12-11T18:14:09.816ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3592025-12-11T18:14:10.553ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3602025-12-11T18:14:10.559ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3612025-12-11T18:14:10.563ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3622025-12-11T18:14:11.296ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3632025-12-11T18:14:11.301ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3642025-12-11T18:14:11.304ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3652025-12-11T18:14:12.207ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3662025-12-11T18:14:12.213ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3672025-12-11T18:14:12.215ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3682025-12-11T18:14:12.810ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3692025-12-11T18:14:12.816ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3702025-12-11T18:14:12.819ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3712025-12-11T18:14:13.733ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3722025-12-11T18:14:13.748ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3732025-12-11T18:14:13.752ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3742025-12-11T18:14:14.475ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3752025-12-11T18:14:14.483ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3762025-12-11T18:14:14.487ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3772025-12-11T18:14:15.075ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3782025-12-11T18:14:15.080ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3792025-12-11T18:14:15.083ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3802025-12-11T18:14:16.586ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3812025-12-11T18:14:16.591ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3822025-12-11T18:14:16.595ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3832025-12-11T18:14:17.563ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3842025-12-11T18:14:17.568ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3852025-12-11T18:14:17.571ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3862025-12-11T18:14:18.389ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3087544612047472304 n_samples = 6 unit = oximeter
3872025-12-11T18:14:18.396ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3882025-12-11T18:14:18.401ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3892025-12-11T18:14:18.403ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3902025-12-11T18:14:19.197ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18269215159268482856 n_samples = 6 unit = oximeter
3912025-12-11T18:14:19.282ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3922025-12-11T18:14:19.283ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 101.455108298s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
3932025-12-11T18:14:19.392ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3942025-12-11T18:14:19.397ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3952025-12-11T18:14:19.399ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3962025-12-11T18:14:20.340ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3972025-12-11T18:14:20.346ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
3982025-12-11T18:14:20.349ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3992025-12-11T18:14:21.105ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4002025-12-11T18:14:21.112ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4012025-12-11T18:14:21.116ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4022025-12-11T18:14:22.509ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4032025-12-11T18:14:22.515ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4042025-12-11T18:14:22.518ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4052025-12-11T18:14:23.032ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4062025-12-11T18:14:23.038ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4072025-12-11T18:14:23.040ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4082025-12-11T18:14:24.253ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4092025-12-11T18:14:24.259ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4102025-12-11T18:14:24.262ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4112025-12-11T18:14:25.651ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4122025-12-11T18:14:25.656ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4132025-12-11T18:14:25.660ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4142025-12-11T18:14:26.447ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4152025-12-11T18:14:26.452ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4162025-12-11T18:14:26.464ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4172025-12-11T18:14:27.185ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4182025-12-11T18:14:27.190ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4192025-12-11T18:14:27.193ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4202025-12-11T18:14:28.392ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3087544612047472304 n_samples = 6 unit = oximeter
4212025-12-11T18:14:28.612ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4222025-12-11T18:14:28.617ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4232025-12-11T18:14:28.620ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4242025-12-11T18:14:29.200ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18269215159268482856 n_samples = 6 unit = oximeter
4252025-12-11T18:14:29.963ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4262025-12-11T18:14:29.973ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4272025-12-11T18:14:29.976ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4282025-12-11T18:14:30.932ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4292025-12-11T18:14:30.944ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4302025-12-11T18:14:30.948ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4312025-12-11T18:14:31.132ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("34187f2f-4826-4991-99b3-2a4ff2992a14.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4ef6e9fe-b880-4221-9db8-d5a1ad5faef5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("fd5f29f9-5ef8-4d2d-bf35-86062269b1e1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("fd5f29f9-5ef8-4d2d-bf35-86062269b1e1.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 1784, tv_nsec: 152872372 } }) unit = producer-server
4322025-12-11T18:14:31.133ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
4332025-12-11T18:14:31.184ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
4342025-12-11T18:14:31.823ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4352025-12-11T18:14:31.832ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4362025-12-11T18:14:31.836ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4372025-12-11T18:14:32.952ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::a]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) }) unit = producer-server
4382025-12-11T18:14:32.954ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 115.126090496s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/e76962a/oximeter/producer/src/lib.rs:371 unit = producer-server
4392025-12-11T18:14:33.245ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4402025-12-11T18:14:33.251ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4412025-12-11T18:14:33.255ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4422025-12-11T18:14:34.076ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4432025-12-11T18:14:34.082ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4442025-12-11T18:14:34.086ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4452025-12-11T18:14:35.416ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4462025-12-11T18:14:35.422ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4472025-12-11T18:14:35.425ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4482025-12-11T18:14:36.933ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4492025-12-11T18:14:36.938ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4502025-12-11T18:14:36.942ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4512025-12-11T18:14:38.332ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4522025-12-11T18:14:38.338ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4532025-12-11T18:14:38.341ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4542025-12-11T18:14:38.395ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3087544612047472304 n_samples = 6 unit = oximeter
4552025-12-11T18:14:38.940ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4562025-12-11T18:14:38.947ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4572025-12-11T18:14:38.950ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4582025-12-11T18:14:39.202ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18269215159268482856 n_samples = 6 unit = oximeter
4592025-12-11T18:14:39.675ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4602025-12-11T18:14:39.682ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4612025-12-11T18:14:39.685ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4622025-12-11T18:14:40.835ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4632025-12-11T18:14:40.840ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4642025-12-11T18:14:40.843ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4652025-12-11T18:14:41.529ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4662025-12-11T18:14:41.534ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4672025-12-11T18:14:41.536ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4682025-12-11T18:14:42.204ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4692025-12-11T18:14:42.210ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4702025-12-11T18:14:42.214ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4712025-12-11T18:14:42.996ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4722025-12-11T18:14:43.002ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4732025-12-11T18:14:43.006ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4742025-12-11T18:14:43.603ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4752025-12-11T18:14:43.608ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4762025-12-11T18:14:43.611ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4772025-12-11T18:14:44.779ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4782025-12-11T18:14:44.785ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4792025-12-11T18:14:44.793ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4802025-12-11T18:14:45.486ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4812025-12-11T18:14:45.491ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4822025-12-11T18:14:45.494ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4832025-12-11T18:14:46.180ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4842025-12-11T18:14:46.185ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4852025-12-11T18:14:46.188ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4862025-12-11T18:14:47.021ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4872025-12-11T18:14:47.027ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4882025-12-11T18:14:47.030ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4892025-12-11T18:14:48.019ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("34187f2f-4826-4991-99b3-2a4ff2992a14.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("4ef6e9fe-b880-4221-9db8-d5a1ad5faef5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("fd5f29f9-5ef8-4d2d-bf35-86062269b1e1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("fd5f29f9-5ef8-4d2d-bf35-86062269b1e1.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::b)) }], valid_until: Instant { tv_sec: 1801, tv_nsec: 39712553 } }) unit = producer-server
4902025-12-11T18:14:48.020ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221 unit = producer-server
4912025-12-11T18:14:48.051ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
4922025-12-11T18:14:48.065ZDEBGtfportd (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "06f9a0f6-96a5-490f-893d-b5bb58648c40", "content-length": "41", "date": "Thu, 11 Dec 2025 18:14:48 GMT"} }) unit = producer-server
4932025-12-11T18:14:48.068ZDEBGtfportd (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s unit = producer-server wait_period = 150s
4942025-12-11T18:14:48.398ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3087544612047472304 n_samples = 6 unit = oximeter
4952025-12-11T18:14:48.533ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4962025-12-11T18:14:48.539ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
4972025-12-11T18:14:48.542ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4982025-12-11T18:14:49.206ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18269215159268482856 n_samples = 6 unit = oximeter
4992025-12-11T18:14:49.363ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5002025-12-11T18:14:49.369ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
5012025-12-11T18:14:49.372ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5022025-12-11T18:14:50.686ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5032025-12-11T18:14:50.692ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
5042025-12-11T18:14:50.695ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5052025-12-11T18:14:51.231ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5062025-12-11T18:14:51.236ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
5072025-12-11T18:14:51.240ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5082025-12-11T18:14:51.807ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5092025-12-11T18:14:51.814ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
5102025-12-11T18:14:51.818ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5112025-12-11T18:14:52.348ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5122025-12-11T18:14:52.354ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
5132025-12-11T18:14:52.357ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5142025-12-11T18:14:53.803ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5152025-12-11T18:14:53.809ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
5162025-12-11T18:14:53.813ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5172025-12-11T18:14:54.830ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5182025-12-11T18:14:54.836ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
5192025-12-11T18:14:54.839ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5202025-12-11T18:14:55.799ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5212025-12-11T18:14:55.805ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
5222025-12-11T18:14:55.808ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5232025-12-11T18:14:56.337ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5242025-12-11T18:14:56.342ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
5252025-12-11T18:14:56.344ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5262025-12-11T18:14:56.875ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5272025-12-11T18:14:56.880ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
5282025-12-11T18:14:56.883ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5292025-12-11T18:14:58.120ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5302025-12-11T18:14:58.126ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
5312025-12-11T18:14:58.130ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5322025-12-11T18:14:58.400ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3087544612047472304 n_samples = 6 unit = oximeter
5332025-12-11T18:14:59.063ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5342025-12-11T18:14:59.069ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
5352025-12-11T18:14:59.072ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5362025-12-11T18:14:59.209ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 18269215159268482856 n_samples = 6 unit = oximeter
5372025-12-11T18:14:59.697ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5382025-12-11T18:14:59.703ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
5392025-12-11T18:14:59.707ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5402025-12-11T18:15:00.223ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5412025-12-11T18:15:00.230ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
5422025-12-11T18:15:00.234ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5432025-12-11T18:15:01.053ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5442025-12-11T18:15:01.063ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
5452025-12-11T18:15:01.068ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5462025-12-11T18:15:01.999ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5472025-12-11T18:15:02.008ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::7cbb:57ff:fe6a:171]
5482025-12-11T18:15:02.015ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]