Max level shown:
1 [ May 18 23:58:02 Enabled. ]
2 [ May 18 23:58:02 Rereading configuration. ]
3 [ May 18 23:58:02 Rereading configuration. ]
4 [ May 18 23:58:13 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ May 18 23:58:13 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-05-18T23:58:13.724ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-05-18T23:58:13.726ZINFOtfportd: connected to dpd running softnpu-187aee7d
92026-05-18T23:58:13.727ZINFOtfportd: running in sync-only mode
102026-05-18T23:58:13.728ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-05-18T23:58:13.729ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-05-18T23:58:13.731ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 0f7e95d1-6105-4c06-a3e4-29cd85aecd6b, ), sled_id: Some( f0b7a3ba-c2b3-47cf-812d-0caebf5c6c6b, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142026-05-18T23:58:13.731ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-05-18T23:58:13.737ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::c8d9:13ff:fe34:cd74->ca:d9:13:34:cd:74 interface = tfportrear0_0
162026-05-18T23:58:13.737ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172026-05-18T23:58:13.743ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
182026-05-18T23:58:13.748ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ May 18 23:58:14 Rereading configuration. ]
20 [ May 18 23:58:14 Executing refresh method (:kill). ]
21 [ May 18 23:58:14 Stopping because all processes in service exited. ]
22 [ May 18 23:58:14 Executing stop method (:kill). ]
23 [ May 18 23:58:14 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ May 18 23:58:14 Method "start" exited with status 0. ]
252026-05-18T23:58:14.339ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262026-05-18T23:58:14.340ZINFOtfportd: connected to dpd running softnpu-187aee7d
272026-05-18T23:58:14.341ZINFOtfportd: running in sync-only mode
282026-05-18T23:58:14.341ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292026-05-18T23:58:14.343ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
302026-05-18T23:58:14.343ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: 0f7e95d1-6105-4c06-a3e4-29cd85aecd6b, sled_id: f0b7a3ba-c2b3-47cf-812d-0caebf5c6c6b, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, fuse: Some(FuseData { chip_rev: ChipRevision { device_id: 272, rev: "B1", rev_num: 2 }, disabled: DisabledFeatures { bsync: false, mau: [0, 0, 0, 0], pgen: false, pipes: 0, ports: 0, resub: false, speeds: 0, tm_mem: 0 }, frequency: FrequencySettings { bps: 3, bps_ext: 0, cpu_speed_dis: 0, disabled: false, pcie_dis: 0, pps: 3, pps_ext: 0 }, manufacturing: ManufacturingData { core_repair: false, die_rotation: false, pmro_and_skew: 0, silent_spin: 0, soft_pipe_dis: 0, tile_repair: false, voltage_scaling: 0, wf_core_repair: false }, part: PartInfo { part_num: 4660, pkg_id: 1, version: 2 } }), lot: None, lotnum: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 7e0001fd-3664-4351-b995-f820d9347145, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
312026-05-18T23:58:14.343ZDEBGtfportd: created producer ID producer_id = 81c93796-95d2-4898-9b5c-dd43e3c6d045 unit = oximeter
322026-05-18T23:58:14.345ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 0f7e95d1-6105-4c06-a3e4-29cd85aecd6b, ), sled_id: Some( f0b7a3ba-c2b3-47cf-812d-0caebf5c6c6b, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
332026-05-18T23:58:14.352ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
342026-05-18T23:58:14.354ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::98e5:b3ff:feff:12ca->9a:e5:b3:ff:12:ca interface = tfportrear0_0
352026-05-18T23:58:14.354ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::c8d9:13ff:fe34:cd74->ca:d9:13:34:cd:74 interface = tfportrear0_0
362026-05-18T23:58:14.355ZDEBGtfportd: registered DTrace probes unit = producer-server
372026-05-18T23:58:14.356ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:52642 method = GET path = /{producer_id} unit = producer-server versions = all
382026-05-18T23:58:14.356ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:52642 unit = producer-server
392026-05-18T23:58:14.356ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:52642 unit = producer-server
402026-05-18T23:58:14.356ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:52642 unit = producer-server
412026-05-18T23:58:14.356ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
422026-05-18T23:58:14.357ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
432026-05-18T23:58:14.357ZDEBGtfportd: starting producer registration task unit = producer-server
442026-05-18T23:58:14.357ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
452026-05-18T23:58:14.357ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:52642 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 81c93796-95d2-4898-9b5c-dd43e3c6d045 unit = producer-server
462026-05-18T23:58:14.357ZINFOtfportd: created oximeter producer server unit = oximeter
472026-05-18T23:58:14.357ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
482026-05-18T23:58:14.358ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
492026-05-18T23:58:14.360ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-05-18T23:57:57.444925071Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
502026-05-18T23:58:14.360ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 15381046761015637614 unit = oximeter
512026-05-18T23:58:14.360ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
522026-05-18T23:58:14.360ZWARNtfportd: tfportqsfp0_0 has no addrs
532026-05-18T23:58:15.315ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
542026-05-18T23:58:15.322ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
552026-05-18T23:58:15.323ZINFOtfportd: added new ARP entry entry = 10.151.1.174->f2:9a:37:40:9b:30 interface = tfportqsfp0_0
562026-05-18T23:58:15.325ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
572026-05-18T23:58:15.325ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
582026-05-18T23:58:15.326ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-05-18T23:57:57.444794498Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
592026-05-18T23:58:15.326ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 14659325249479686943 unit = oximeter
602026-05-18T23:58:15.326ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
612026-05-18T23:58:16.213ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
622026-05-18T23:58:16.218ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
632026-05-18T23:58:16.221ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
642026-05-18T23:58:17.412ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
652026-05-18T23:58:17.417ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
662026-05-18T23:58:17.420ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
672026-05-18T23:58:18.715ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
682026-05-18T23:58:18.771ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
692026-05-18T23:58:18.773ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
702026-05-18T23:58:19.360ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("02b3aa9b-32d7-469a-85e5-370ac7865f06.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("8ac677dc-b52b-4513-9850-c7284998e50c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b44c1090-e8f8-43dd-8a3d-45d34a9aea06.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("b44c1090-e8f8-43dd-8a3d-45d34a9aea06.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 3971, tv_nsec: 340264911 } }) unit = producer-server
712026-05-18T23:58:19.360ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
722026-05-18T23:58:19.378ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
732026-05-18T23:58:19.557ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
742026-05-18T23:58:19.562ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
752026-05-18T23:58:19.565ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
762026-05-18T23:58:21.002ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
772026-05-18T23:58:21.005ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
782026-05-18T23:58:21.008ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
792026-05-18T23:58:22.004ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
802026-05-18T23:58:22.009ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
812026-05-18T23:58:22.012ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
822026-05-18T23:58:23.493ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
832026-05-18T23:58:23.498ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
842026-05-18T23:58:23.501ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
852026-05-18T23:58:24.364ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15381046761015637614 n_samples = 6 unit = oximeter
862026-05-18T23:58:24.911ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
872026-05-18T23:58:24.916ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
882026-05-18T23:58:24.918ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
892026-05-18T23:58:25.328ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14659325249479686943 n_samples = 6 unit = oximeter
902026-05-18T23:58:25.662ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
912026-05-18T23:58:25.666ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
922026-05-18T23:58:25.669ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
932026-05-18T23:58:26.783ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
942026-05-18T23:58:26.787ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
952026-05-18T23:58:26.790ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
962026-05-18T23:58:27.417ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
972026-05-18T23:58:27.421ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
982026-05-18T23:58:27.424ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
992026-05-18T23:58:28.095ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1002026-05-18T23:58:28.100ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1012026-05-18T23:58:28.104ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1022026-05-18T23:58:29.551ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1032026-05-18T23:58:29.557ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1042026-05-18T23:58:29.559ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1052026-05-18T23:58:30.236ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1062026-05-18T23:58:30.239ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1072026-05-18T23:58:30.242ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1082026-05-18T23:58:31.400ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1092026-05-18T23:58:31.406ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1102026-05-18T23:58:31.409ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1112026-05-18T23:58:32.275ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1122026-05-18T23:58:32.285ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1132026-05-18T23:58:32.293ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1142026-05-18T23:58:32.954ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1152026-05-18T23:58:32.960ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1162026-05-18T23:58:32.963ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1172026-05-18T23:58:33.558ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1182026-05-18T23:58:33.563ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1192026-05-18T23:58:33.566ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1202026-05-18T23:58:34.753ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1212026-05-18T23:58:34.757ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15381046761015637614 n_samples = 6 unit = oximeter
1222026-05-18T23:58:34.759ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1232026-05-18T23:58:34.762ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1242026-05-18T23:58:34.770ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1252026-05-18T23:58:34.771ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 20.023490694s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1262026-05-18T23:58:35.094ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("02b3aa9b-32d7-469a-85e5-370ac7865f06.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("8ac677dc-b52b-4513-9850-c7284998e50c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b44c1090-e8f8-43dd-8a3d-45d34a9aea06.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("b44c1090-e8f8-43dd-8a3d-45d34a9aea06.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 3986, tv_nsec: 684717462 } }) unit = producer-server
1272026-05-18T23:58:35.095ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
1282026-05-18T23:58:35.398ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1292026-05-18T23:58:35.813ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14659325249479686943 n_samples = 6 unit = oximeter
1302026-05-18T23:58:35.917ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1312026-05-18T23:58:35.941ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1322026-05-18T23:58:35.952ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1332026-05-18T23:58:37.081ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1342026-05-18T23:58:37.082ZINFOtfportd: removed stale NDP entry :fe80::98e5:b3ff:feff:12ca->9a:e5:b3:ff:12:ca
1352026-05-18T23:58:37.087ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1362026-05-18T23:58:37.091ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1372026-05-18T23:58:38.009ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::98e5:b3ff:feff:12ca->9a:e5:b3:ff:12:ca interface = tfportrear0_0
1382026-05-18T23:58:38.272ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1392026-05-18T23:58:38.278ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1402026-05-18T23:58:38.281ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1412026-05-18T23:58:39.383ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1422026-05-18T23:58:39.388ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1432026-05-18T23:58:39.392ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1442026-05-18T23:58:40.400ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1452026-05-18T23:58:40.404ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1462026-05-18T23:58:40.407ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1472026-05-18T23:58:41.212ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1482026-05-18T23:58:41.219ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1492026-05-18T23:58:41.223ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1502026-05-18T23:58:42.617ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1512026-05-18T23:58:42.622ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1522026-05-18T23:58:42.625ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1532026-05-18T23:58:43.830ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1542026-05-18T23:58:43.836ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1552026-05-18T23:58:43.841ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1562026-05-18T23:58:44.378ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1572026-05-18T23:58:44.382ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1582026-05-18T23:58:44.384ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1592026-05-18T23:58:44.736ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15381046761015637614 n_samples = 6 unit = oximeter
1602026-05-18T23:58:45.157ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1612026-05-18T23:58:45.162ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1622026-05-18T23:58:45.165ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1632026-05-18T23:58:45.788ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14659325249479686943 n_samples = 6 unit = oximeter
1642026-05-18T23:58:46.064ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1652026-05-18T23:58:46.069ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1662026-05-18T23:58:46.072ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1672026-05-18T23:58:46.654ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1682026-05-18T23:58:46.661ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1692026-05-18T23:58:46.666ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1702026-05-18T23:58:47.298ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1712026-05-18T23:58:47.303ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1722026-05-18T23:58:47.306ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1732026-05-18T23:58:47.875ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1742026-05-18T23:58:47.885ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1752026-05-18T23:58:47.889ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1762026-05-18T23:58:48.512ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1772026-05-18T23:58:48.517ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1782026-05-18T23:58:48.520ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1792026-05-18T23:58:49.252ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1802026-05-18T23:58:49.256ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1812026-05-18T23:58:49.259ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1822026-05-18T23:58:50.342ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1832026-05-18T23:58:50.346ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 35.640228519s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1842026-05-18T23:58:50.476ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1852026-05-18T23:58:50.481ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1862026-05-18T23:58:50.484ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1872026-05-18T23:58:50.812ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("02b3aa9b-32d7-469a-85e5-370ac7865f06.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("8ac677dc-b52b-4513-9850-c7284998e50c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b44c1090-e8f8-43dd-8a3d-45d34a9aea06.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("b44c1090-e8f8-43dd-8a3d-45d34a9aea06.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 4002, tv_nsec: 444523552 } }) unit = producer-server
1882026-05-18T23:58:50.812ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
1892026-05-18T23:58:50.821ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1902026-05-18T23:58:51.239ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1912026-05-18T23:58:51.244ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1922026-05-18T23:58:51.247ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1932026-05-18T23:58:52.608ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1942026-05-18T23:58:52.612ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1952026-05-18T23:58:52.615ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1962026-05-18T23:58:53.799ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1972026-05-18T23:58:53.805ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
1982026-05-18T23:58:53.808ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1992026-05-18T23:58:54.446ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2002026-05-18T23:58:54.451ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2012026-05-18T23:58:54.454ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2022026-05-18T23:58:54.712ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15381046761015637614 n_samples = 6 unit = oximeter
2032026-05-18T23:58:55.039ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2042026-05-18T23:58:55.044ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2052026-05-18T23:58:55.047ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2062026-05-18T23:58:55.763ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14659325249479686943 n_samples = 6 unit = oximeter
2072026-05-18T23:58:55.838ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2082026-05-18T23:58:55.845ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2092026-05-18T23:58:55.849ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2102026-05-18T23:58:58.176ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2112026-05-18T23:58:58.212ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2122026-05-18T23:58:58.228ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2132026-05-18T23:58:59.236ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2142026-05-18T23:58:59.243ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2152026-05-18T23:58:59.248ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2162026-05-18T23:59:00.132ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2172026-05-18T23:59:00.140ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2182026-05-18T23:59:00.145ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2192026-05-18T23:59:00.796ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2202026-05-18T23:59:00.803ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2212026-05-18T23:59:00.806ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2222026-05-18T23:59:01.429ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2232026-05-18T23:59:01.436ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2242026-05-18T23:59:01.440ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2252026-05-18T23:59:02.193ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2262026-05-18T23:59:02.198ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2272026-05-18T23:59:02.202ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2282026-05-18T23:59:02.886ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2292026-05-18T23:59:02.891ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2302026-05-18T23:59:02.894ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2312026-05-18T23:59:03.536ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2322026-05-18T23:59:03.542ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2332026-05-18T23:59:03.545ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2342026-05-18T23:59:04.540ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2352026-05-18T23:59:04.545ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2362026-05-18T23:59:04.573ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2372026-05-18T23:59:04.717ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15381046761015637614 n_samples = 6 unit = oximeter
2382026-05-18T23:59:05.435ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2392026-05-18T23:59:05.440ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2402026-05-18T23:59:05.442ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2412026-05-18T23:59:05.753ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14659325249479686943 n_samples = 6 unit = oximeter
2422026-05-18T23:59:05.785ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2432026-05-18T23:59:05.814ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 51.150281294s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2442026-05-18T23:59:06.812ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2452026-05-18T23:59:06.822ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2462026-05-18T23:59:06.825ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2472026-05-18T23:59:06.968ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("02b3aa9b-32d7-469a-85e5-370ac7865f06.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("8ac677dc-b52b-4513-9850-c7284998e50c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b44c1090-e8f8-43dd-8a3d-45d34a9aea06.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("b44c1090-e8f8-43dd-8a3d-45d34a9aea06.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 4018, tv_nsec: 644865599 } }) unit = producer-server
2482026-05-18T23:59:06.972ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
2492026-05-18T23:59:07.016ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
2502026-05-18T23:59:07.869ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2512026-05-18T23:59:07.874ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2522026-05-18T23:59:07.877ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2532026-05-18T23:59:09.342ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2542026-05-18T23:59:09.347ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2552026-05-18T23:59:09.350ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2562026-05-18T23:59:10.743ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2572026-05-18T23:59:10.748ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2582026-05-18T23:59:10.752ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2592026-05-18T23:59:11.564ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2602026-05-18T23:59:11.570ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2612026-05-18T23:59:11.573ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2622026-05-18T23:59:12.185ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2632026-05-18T23:59:12.190ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2642026-05-18T23:59:12.193ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2652026-05-18T23:59:13.545ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2662026-05-18T23:59:13.550ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2672026-05-18T23:59:13.553ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2682026-05-18T23:59:14.714ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15381046761015637614 n_samples = 6 unit = oximeter
2692026-05-18T23:59:14.975ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2702026-05-18T23:59:14.982ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2712026-05-18T23:59:14.985ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2722026-05-18T23:59:15.753ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14659325249479686943 n_samples = 6 unit = oximeter
2732026-05-18T23:59:15.818ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2742026-05-18T23:59:15.823ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2752026-05-18T23:59:15.826ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2762026-05-18T23:59:17.038ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2772026-05-18T23:59:17.044ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2782026-05-18T23:59:17.047ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2792026-05-18T23:59:17.838ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2802026-05-18T23:59:17.844ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2812026-05-18T23:59:17.847ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2822026-05-18T23:59:19.183ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2832026-05-18T23:59:19.188ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2842026-05-18T23:59:19.192ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2852026-05-18T23:59:20.156ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2862026-05-18T23:59:20.165ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2872026-05-18T23:59:20.172ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2882026-05-18T23:59:20.973ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2892026-05-18T23:59:20.988ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2902026-05-18T23:59:20.996ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2912026-05-18T23:59:22.047ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2922026-05-18T23:59:22.065ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 67.402006326s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2932026-05-18T23:59:32.810ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2942026-05-18T23:59:33.268ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
2952026-05-18T23:59:33.395ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2962026-05-18T23:59:33.427ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("02b3aa9b-32d7-469a-85e5-370ac7865f06.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("8ac677dc-b52b-4513-9850-c7284998e50c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b44c1090-e8f8-43dd-8a3d-45d34a9aea06.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("b44c1090-e8f8-43dd-8a3d-45d34a9aea06.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 4045, tv_nsec: 100771871 } }) unit = producer-server
2972026-05-18T23:59:35.040ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
2982026-05-18T23:59:35.079ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2992026-05-18T23:59:35.297ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3002026-05-18T23:59:35.760ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15381046761015637614 n_samples = 6 unit = oximeter
3012026-05-18T23:59:35.761ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14659325249479686943 n_samples = 6 unit = oximeter
3022026-05-18T23:59:35.862ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3032026-05-18T23:59:35.865ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
3042026-05-18T23:59:37.409ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3052026-05-18T23:59:37.414ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3062026-05-18T23:59:37.418ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3072026-05-18T23:59:37.953ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3082026-05-18T23:59:38.047ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3092026-05-18T23:59:38.056ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3102026-05-18T23:59:39.050ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3112026-05-18T23:59:39.055ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3122026-05-18T23:59:39.068ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3132026-05-18T23:59:39.789ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3142026-05-18T23:59:39.795ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3152026-05-18T23:59:39.798ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3162026-05-18T23:59:40.328ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3172026-05-18T23:59:40.333ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3182026-05-18T23:59:40.337ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3192026-05-18T23:59:41.580ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3202026-05-18T23:59:41.585ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3212026-05-18T23:59:41.588ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3222026-05-18T23:59:42.801ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3232026-05-18T23:59:42.809ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3242026-05-18T23:59:42.814ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3252026-05-18T23:59:43.599ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3262026-05-18T23:59:43.605ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3272026-05-18T23:59:43.609ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3282026-05-18T23:59:44.157ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3292026-05-18T23:59:44.162ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3302026-05-18T23:59:44.165ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3312026-05-18T23:59:45.623ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3322026-05-18T23:59:45.629ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3332026-05-18T23:59:45.633ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3342026-05-18T23:59:45.763ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15381046761015637614 n_samples = 6 unit = oximeter
3352026-05-18T23:59:45.764ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14659325249479686943 n_samples = 6 unit = oximeter
3362026-05-18T23:59:46.713ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3372026-05-18T23:59:46.718ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3382026-05-18T23:59:46.728ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3392026-05-18T23:59:47.484ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3402026-05-18T23:59:47.489ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3412026-05-18T23:59:47.492ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3422026-05-18T23:59:48.199ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3432026-05-18T23:59:48.205ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3442026-05-18T23:59:48.221ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3452026-05-18T23:59:48.754ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3462026-05-18T23:59:48.761ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3472026-05-18T23:59:48.766ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3482026-05-18T23:59:49.418ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3492026-05-18T23:59:49.424ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3502026-05-18T23:59:49.428ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3512026-05-18T23:59:50.724ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3522026-05-18T23:59:50.731ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3532026-05-18T23:59:50.735ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3542026-05-18T23:59:50.868ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3552026-05-18T23:59:50.874ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 96.210860379s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3562026-05-18T23:59:51.930ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3572026-05-18T23:59:51.934ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3582026-05-18T23:59:51.937ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3592026-05-18T23:59:53.431ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3602026-05-18T23:59:53.438ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3612026-05-18T23:59:53.442ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3622026-05-18T23:59:54.068ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3632026-05-18T23:59:54.076ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3642026-05-18T23:59:54.079ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3652026-05-18T23:59:54.915ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("02b3aa9b-32d7-469a-85e5-370ac7865f06.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("8ac677dc-b52b-4513-9850-c7284998e50c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("b44c1090-e8f8-43dd-8a3d-45d34a9aea06.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("b44c1090-e8f8-43dd-8a3d-45d34a9aea06.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 4066, tv_nsec: 589614464 } }) unit = producer-server
3662026-05-18T23:59:54.915ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
3672026-05-18T23:59:54.925ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
3682026-05-18T23:59:55.188ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3692026-05-18T23:59:55.196ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3702026-05-18T23:59:55.199ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3712026-05-18T23:59:55.766ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15381046761015637614 n_samples = 6 unit = oximeter
3722026-05-18T23:59:55.768ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 14659325249479686943 n_samples = 6 unit = oximeter
3732026-05-18T23:59:56.158ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3742026-05-18T23:59:56.164ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3752026-05-18T23:59:56.168ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3762026-05-18T23:59:57.393ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3772026-05-18T23:59:57.398ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3782026-05-18T23:59:57.401ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3792026-05-18T23:59:58.457ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3802026-05-18T23:59:58.465ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3812026-05-18T23:59:58.469ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3822026-05-18T23:59:59.201ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3832026-05-18T23:59:59.212ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3842026-05-18T23:59:59.216ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3852026-05-19T00:00:00.321ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3862026-05-19T00:00:00.329ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::c8d9:13ff:fe34:cd74]
3872026-05-19T00:00:00.334ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]