Max level shown:
1 [ May 28 22:12:13 Enabled. ]
2 [ May 28 22:12:13 Rereading configuration. ]
3 [ May 28 22:12:14 Rereading configuration. ]
4 [ May 28 22:12:25 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ May 28 22:12:25 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-05-28T22:12:25.615ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-05-28T22:12:25.617ZINFOtfportd: connected to dpd running softnpu-187aee7d
92026-05-28T22:12:25.617ZINFOtfportd: running in sync-only mode
102026-05-28T22:12:25.618ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-05-28T22:12:25.620ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-05-28T22:12:25.621ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 24b90d8b-a4b0-462d-9f5a-463c80e3b3f4, ), sled_id: Some( 7cc30de8-449d-4c83-99fe-c7b76e8166f8, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
142026-05-28T22:12:25.621ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-05-28T22:12:25.625ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::80f5:59ff:fe47:8b18->82:f5:59:47:8b:18 interface = tfportrear0_0
162026-05-28T22:12:25.626ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::fc63:b4ff:fe58:7e9f->fe:63:b4:58:7e:9f interface = tfportrear0_0
172026-05-28T22:12:25.627ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
182026-05-28T22:12:25.633ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
192026-05-28T22:12:25.638ZWARNtfportd: tfportqsfp0_0 has no addrs
20 [ May 28 22:12:26 Rereading configuration. ]
21 [ May 28 22:12:26 Executing refresh method (:kill). ]
22 [ May 28 22:12:26 Stopping because all processes in service exited. ]
23 [ May 28 22:12:26 Executing stop method (:kill). ]
24 [ May 28 22:12:26 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
25 [ May 28 22:12:26 Method "start" exited with status 0. ]
262026-05-28T22:12:26.341ZINFOtfportd: connecting to dpd host = [::1] port = 12224
272026-05-28T22:12:26.342ZINFOtfportd: connected to dpd running softnpu-187aee7d
282026-05-28T22:12:26.342ZINFOtfportd: running in sync-only mode
292026-05-28T22:12:26.342ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
302026-05-28T22:12:26.344ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
312026-05-28T22:12:26.344ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: 24b90d8b-a4b0-462d-9f5a-463c80e3b3f4, sled_id: 7cc30de8-449d-4c83-99fe-c7b76e8166f8, model: "i86pc", revision: 0, serial: "buskin" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, fuse: Some(FuseData { chip_rev: ChipRevision { device_id: 272, rev: "B1", rev_num: 2 }, disabled: DisabledFeatures { bsync: false, mau: [0, 0, 0, 0], pgen: false, pipes: 0, ports: 0, resub: false, speeds: 0, tm_mem: 0 }, frequency: FrequencySettings { bps: 3, bps_ext: 0, cpu_speed_dis: 0, disabled: false, pcie_dis: 0, pps: 3, pps_ext: 0 }, manufacturing: ManufacturingData { core_repair: false, die_rotation: false, pmro_and_skew: 0, silent_spin: 0, soft_pipe_dis: 0, tile_repair: false, voltage_scaling: 0, wf_core_repair: false }, part: PartInfo { part_num: 4660, pkg_id: 1, version: 2 } }), lot: None, lotnum: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 268e7f54-12a1-40a2-847c-95e2df058fda, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
322026-05-28T22:12:26.344ZDEBGtfportd: created producer ID producer_id = 7ef47f37-f28c-4a0c-82d8-146931675ad6 unit = oximeter
332026-05-28T22:12:26.346ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( 24b90d8b-a4b0-462d-9f5a-463c80e3b3f4, ), sled_id: Some( 7cc30de8-449d-4c83-99fe-c7b76e8166f8, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "buskin", ), }
342026-05-28T22:12:26.353ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
352026-05-28T22:12:26.354ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::80f5:59ff:fe47:8b18->82:f5:59:47:8b:18 interface = tfportrear0_0
362026-05-28T22:12:26.355ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::fc63:b4ff:fe58:7e9f->fe:63:b4:58:7e:9f interface = tfportrear0_0
372026-05-28T22:12:26.356ZDEBGtfportd: registered DTrace probes unit = producer-server
382026-05-28T22:12:26.357ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:53549 method = GET path = /{producer_id} unit = producer-server versions = all
392026-05-28T22:12:26.357ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:53549 unit = producer-server
402026-05-28T22:12:26.357ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:53549 unit = producer-server
412026-05-28T22:12:26.357ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:53549 unit = producer-server
422026-05-28T22:12:26.357ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
432026-05-28T22:12:26.358ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
442026-05-28T22:12:26.358ZDEBGtfportd: starting producer registration task unit = producer-server
452026-05-28T22:12:26.358ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:53549 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 7ef47f37-f28c-4a0c-82d8-146931675ad6 unit = producer-server
462026-05-28T22:12:26.358ZINFOtfportd: created oximeter producer server unit = oximeter
472026-05-28T22:12:26.358ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
482026-05-28T22:12:26.359ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
492026-05-28T22:12:26.359ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
502026-05-28T22:12:26.360ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-05-28T22:12:09.469948715Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
512026-05-28T22:12:26.360ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 15466005652246622490 unit = oximeter
522026-05-28T22:12:26.360ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
532026-05-28T22:12:26.362ZWARNtfportd: tfportqsfp0_0 has no addrs
542026-05-28T22:12:27.491ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
552026-05-28T22:12:27.497ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
562026-05-28T22:12:27.500ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
572026-05-28T22:12:27.500ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
582026-05-28T22:12:27.500ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-05-28T22:12:09.469816485Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
592026-05-28T22:12:27.501ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 10917210643743581506 unit = oximeter
602026-05-28T22:12:27.501ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
612026-05-28T22:12:27.627ZINFOtfportd: added new ARP entry entry = 10.151.1.174->2e:fa:a7:7f:95:de interface = tfportqsfp0_0
622026-05-28T22:12:28.593ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
632026-05-28T22:12:28.599ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
642026-05-28T22:12:28.602ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
652026-05-28T22:12:29.770ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
662026-05-28T22:12:29.775ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
672026-05-28T22:12:29.778ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
682026-05-28T22:12:30.861ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
692026-05-28T22:12:30.865ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
702026-05-28T22:12:30.869ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
712026-05-28T22:12:31.361ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("80f5c51a-a935-44d3-9ca0-c31eb65c4ab1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9fdf1c1d-eae7-4c21-b14f-4c4065398273.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f57dc2f6-0fff-4f5e-9cd8-89d49def9d20.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f57dc2f6-0fff-4f5e-9cd8-89d49def9d20.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1270, tv_nsec: 752185183 } }) unit = producer-server
722026-05-28T22:12:31.361ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
732026-05-28T22:12:31.381ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
742026-05-28T22:12:31.640ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
752026-05-28T22:12:31.646ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
762026-05-28T22:12:31.649ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
772026-05-28T22:12:32.862ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
782026-05-28T22:12:32.867ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
792026-05-28T22:12:32.870ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
802026-05-28T22:12:33.620ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
812026-05-28T22:12:33.625ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
822026-05-28T22:12:33.628ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
832026-05-28T22:12:34.664ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
842026-05-28T22:12:34.669ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
852026-05-28T22:12:34.672ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
862026-05-28T22:12:36.171ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
872026-05-28T22:12:36.177ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
882026-05-28T22:12:36.180ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
892026-05-28T22:12:36.365ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15466005652246622490 n_samples = 6 unit = oximeter
902026-05-28T22:12:36.959ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
912026-05-28T22:12:36.964ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
922026-05-28T22:12:36.966ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
932026-05-28T22:12:37.503ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10917210643743581506 n_samples = 6 unit = oximeter
942026-05-28T22:12:37.681ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
952026-05-28T22:12:37.685ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
962026-05-28T22:12:37.688ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
972026-05-28T22:12:38.418ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
982026-05-28T22:12:38.424ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
992026-05-28T22:12:38.426ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1002026-05-28T22:12:39.008ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1012026-05-28T22:12:39.013ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1022026-05-28T22:12:39.016ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1032026-05-28T22:12:40.298ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1042026-05-28T22:12:40.303ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1052026-05-28T22:12:40.306ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1062026-05-28T22:12:41.595ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1072026-05-28T22:12:41.599ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1082026-05-28T22:12:41.602ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1092026-05-28T22:12:43.097ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1102026-05-28T22:12:43.102ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1112026-05-28T22:12:43.105ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1122026-05-28T22:12:44.190ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1132026-05-28T22:12:44.195ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1142026-05-28T22:12:44.198ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1152026-05-28T22:12:44.794ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1162026-05-28T22:12:44.798ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1172026-05-28T22:12:44.801ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1182026-05-28T22:12:46.222ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1192026-05-28T22:12:46.226ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1202026-05-28T22:12:46.229ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1212026-05-28T22:12:46.890ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15466005652246622490 n_samples = 6 unit = oximeter
1222026-05-28T22:12:46.905ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1232026-05-28T22:12:46.907ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 20.025481142s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1242026-05-28T22:12:47.120ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("80f5c51a-a935-44d3-9ca0-c31eb65c4ab1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9fdf1c1d-eae7-4c21-b14f-4c4065398273.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f57dc2f6-0fff-4f5e-9cd8-89d49def9d20.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f57dc2f6-0fff-4f5e-9cd8-89d49def9d20.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1285, tv_nsec: 988910262 } }) unit = producer-server
1252026-05-28T22:12:47.121ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
1262026-05-28T22:12:47.129ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1272026-05-28T22:12:47.403ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1282026-05-28T22:12:47.408ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1292026-05-28T22:12:47.411ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1302026-05-28T22:12:48.025ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10917210643743581506 n_samples = 6 unit = oximeter
1312026-05-28T22:12:48.114ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1322026-05-28T22:12:48.119ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1332026-05-28T22:12:48.122ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1342026-05-28T22:12:49.260ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1352026-05-28T22:12:49.266ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1362026-05-28T22:12:49.269ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1372026-05-28T22:12:49.790ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1382026-05-28T22:12:49.794ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1392026-05-28T22:12:49.797ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1402026-05-28T22:12:51.022ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1412026-05-28T22:12:51.026ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1422026-05-28T22:12:51.029ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1432026-05-28T22:12:51.905ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1442026-05-28T22:12:51.913ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1452026-05-28T22:12:51.917ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1462026-05-28T22:12:53.436ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1472026-05-28T22:12:53.449ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1482026-05-28T22:12:53.461ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1492026-05-28T22:12:54.339ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1502026-05-28T22:12:54.345ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1512026-05-28T22:12:54.349ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1522026-05-28T22:12:55.207ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1532026-05-28T22:12:55.214ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1542026-05-28T22:12:55.219ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1552026-05-28T22:12:55.784ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1562026-05-28T22:12:55.798ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1572026-05-28T22:12:55.802ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1582026-05-28T22:12:56.672ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1592026-05-28T22:12:56.680ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1602026-05-28T22:12:56.683ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1612026-05-28T22:12:56.865ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15466005652246622490 n_samples = 6 unit = oximeter
1622026-05-28T22:12:57.499ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1632026-05-28T22:12:57.504ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1642026-05-28T22:12:57.512ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1652026-05-28T22:12:58.000ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10917210643743581506 n_samples = 6 unit = oximeter
1662026-05-28T22:12:58.765ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1672026-05-28T22:12:58.771ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1682026-05-28T22:12:58.775ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1692026-05-28T22:13:00.279ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1702026-05-28T22:13:00.284ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1712026-05-28T22:13:00.287ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1722026-05-28T22:13:01.604ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1732026-05-28T22:13:01.609ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1742026-05-28T22:13:01.612ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1752026-05-28T22:13:02.098ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1762026-05-28T22:13:02.099ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 35.250060456s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1772026-05-28T22:13:02.610ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1782026-05-28T22:13:02.615ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1792026-05-28T22:13:02.618ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1802026-05-28T22:13:02.754ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("80f5c51a-a935-44d3-9ca0-c31eb65c4ab1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9fdf1c1d-eae7-4c21-b14f-4c4065398273.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f57dc2f6-0fff-4f5e-9cd8-89d49def9d20.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f57dc2f6-0fff-4f5e-9cd8-89d49def9d20.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1301, tv_nsec: 653107471 } }) unit = producer-server
1812026-05-28T22:13:02.754ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
1822026-05-28T22:13:02.762ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1832026-05-28T22:13:03.839ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1842026-05-28T22:13:03.845ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1852026-05-28T22:13:03.849ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1862026-05-28T22:13:09.525ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15466005652246622490 n_samples = 6 unit = oximeter
1872026-05-28T22:13:09.526ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10917210643743581506 n_samples = 6 unit = oximeter
1882026-05-28T22:13:09.528ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1892026-05-28T22:13:09.537ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1902026-05-28T22:13:09.567ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1912026-05-28T22:13:10.646ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1922026-05-28T22:13:10.664ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1932026-05-28T22:13:10.668ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1942026-05-28T22:13:11.843ZINFOtfportd: removed stale NDP entry :fe80::80f5:59ff:fe47:8b18->82:f5:59:47:8b:18
1952026-05-28T22:13:12.133ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1962026-05-28T22:13:12.140ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
1972026-05-28T22:13:12.144ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
1982026-05-28T22:13:13.337ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1992026-05-28T22:13:13.342ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2002026-05-28T22:13:13.345ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2012026-05-28T22:13:13.589ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::80f5:59ff:fe47:8b18->82:f5:59:47:8b:18 interface = tfportrear0_0
2022026-05-28T22:13:14.351ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2032026-05-28T22:13:14.358ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2042026-05-28T22:13:14.361ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2052026-05-28T22:13:15.864ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2062026-05-28T22:13:15.870ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2072026-05-28T22:13:15.873ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2082026-05-28T22:13:17.049ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2092026-05-28T22:13:17.053ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2102026-05-28T22:13:17.056ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2112026-05-28T22:13:17.767ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2122026-05-28T22:13:17.773ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 50.924226384s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2132026-05-28T22:13:18.305ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2142026-05-28T22:13:18.310ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2152026-05-28T22:13:18.313ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2162026-05-28T22:13:18.722ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("80f5c51a-a935-44d3-9ca0-c31eb65c4ab1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9fdf1c1d-eae7-4c21-b14f-4c4065398273.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f57dc2f6-0fff-4f5e-9cd8-89d49def9d20.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f57dc2f6-0fff-4f5e-9cd8-89d49def9d20.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1317, tv_nsec: 622376103 } }) unit = producer-server
2172026-05-28T22:13:18.723ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
2182026-05-28T22:13:18.740ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
2192026-05-28T22:13:18.848ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2202026-05-28T22:13:18.853ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2212026-05-28T22:13:18.856ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2222026-05-28T22:13:19.383ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2232026-05-28T22:13:19.389ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2242026-05-28T22:13:19.392ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2252026-05-28T22:13:19.529ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15466005652246622490 n_samples = 6 unit = oximeter
2262026-05-28T22:13:19.530ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10917210643743581506 n_samples = 6 unit = oximeter
2272026-05-28T22:13:20.808ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2282026-05-28T22:13:20.813ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2292026-05-28T22:13:20.816ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2302026-05-28T22:13:21.683ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2312026-05-28T22:13:21.687ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2322026-05-28T22:13:21.690ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2332026-05-28T22:13:23.047ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2342026-05-28T22:13:23.052ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2352026-05-28T22:13:23.055ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2362026-05-28T22:13:24.024ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2372026-05-28T22:13:24.029ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2382026-05-28T22:13:24.033ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2392026-05-28T22:13:25.486ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2402026-05-28T22:13:25.493ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2412026-05-28T22:13:25.497ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2422026-05-28T22:13:26.504ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2432026-05-28T22:13:26.508ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2442026-05-28T22:13:26.511ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2452026-05-28T22:13:27.186ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2462026-05-28T22:13:27.190ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2472026-05-28T22:13:27.193ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2482026-05-28T22:13:27.747ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2492026-05-28T22:13:27.752ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2502026-05-28T22:13:27.755ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2512026-05-28T22:13:28.822ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2522026-05-28T22:13:28.827ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2532026-05-28T22:13:28.831ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2542026-05-28T22:13:29.350ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2552026-05-28T22:13:29.354ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2562026-05-28T22:13:29.357ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2572026-05-28T22:13:29.532ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15466005652246622490 n_samples = 6 unit = oximeter
2582026-05-28T22:13:29.533ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10917210643743581506 n_samples = 6 unit = oximeter
2592026-05-28T22:13:30.832ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2602026-05-28T22:13:30.837ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2612026-05-28T22:13:30.840ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2622026-05-28T22:13:32.314ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2632026-05-28T22:13:32.319ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2642026-05-28T22:13:32.322ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2652026-05-28T22:13:32.901ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2662026-05-28T22:13:32.907ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2672026-05-28T22:13:32.910ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2682026-05-28T22:13:33.742ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2692026-05-28T22:13:33.743ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 66.893731379s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2702026-05-28T22:13:34.155ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2712026-05-28T22:13:34.160ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2722026-05-28T22:13:34.163ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2732026-05-28T22:13:35.257ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2742026-05-28T22:13:35.263ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2752026-05-28T22:13:35.265ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2762026-05-28T22:13:36.321ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("80f5c51a-a935-44d3-9ca0-c31eb65c4ab1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9fdf1c1d-eae7-4c21-b14f-4c4065398273.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f57dc2f6-0fff-4f5e-9cd8-89d49def9d20.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f57dc2f6-0fff-4f5e-9cd8-89d49def9d20.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1335, tv_nsec: 220217270 } }) unit = producer-server
2772026-05-28T22:13:36.321ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
2782026-05-28T22:13:36.328ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
2792026-05-28T22:13:36.722ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2802026-05-28T22:13:36.728ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2812026-05-28T22:13:36.731ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2822026-05-28T22:13:37.607ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2832026-05-28T22:13:37.612ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2842026-05-28T22:13:37.615ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2852026-05-28T22:13:38.557ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2862026-05-28T22:13:38.562ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2872026-05-28T22:13:38.566ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2882026-05-28T22:13:39.160ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2892026-05-28T22:13:39.166ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2902026-05-28T22:13:39.168ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2912026-05-28T22:13:39.535ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15466005652246622490 n_samples = 6 unit = oximeter
2922026-05-28T22:13:39.536ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10917210643743581506 n_samples = 6 unit = oximeter
2932026-05-28T22:13:39.704ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2942026-05-28T22:13:39.709ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2952026-05-28T22:13:39.712ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2962026-05-28T22:13:41.009ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2972026-05-28T22:13:41.014ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
2982026-05-28T22:13:41.017ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
2992026-05-28T22:13:42.188ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3002026-05-28T22:13:42.198ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3012026-05-28T22:13:42.204ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3022026-05-28T22:13:43.236ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3032026-05-28T22:13:43.241ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3042026-05-28T22:13:43.244ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3052026-05-28T22:13:44.503ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3062026-05-28T22:13:44.509ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3072026-05-28T22:13:44.512ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3082026-05-28T22:13:45.677ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3092026-05-28T22:13:45.682ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3102026-05-28T22:13:45.685ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3112026-05-28T22:13:46.917ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3122026-05-28T22:13:46.923ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3132026-05-28T22:13:46.926ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3142026-05-28T22:13:47.952ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3152026-05-28T22:13:47.958ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3162026-05-28T22:13:47.961ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3172026-05-28T22:13:48.963ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3182026-05-28T22:13:48.968ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3192026-05-28T22:13:48.971ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3202026-05-28T22:13:49.535ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15466005652246622490 n_samples = 6 unit = oximeter
3212026-05-28T22:13:49.537ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10917210643743581506 n_samples = 6 unit = oximeter
3222026-05-28T22:13:49.604ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3232026-05-28T22:13:49.609ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3242026-05-28T22:13:49.612ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3252026-05-28T22:13:50.462ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3262026-05-28T22:13:50.468ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3272026-05-28T22:13:50.471ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3282026-05-28T22:13:51.328ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3292026-05-28T22:13:51.329ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 84.479560813s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3302026-05-28T22:13:51.867ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3312026-05-28T22:13:51.873ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3322026-05-28T22:13:51.876ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3332026-05-28T22:13:52.618ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3342026-05-28T22:13:52.624ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3352026-05-28T22:13:52.627ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3362026-05-28T22:13:54.025ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3372026-05-28T22:13:54.031ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3382026-05-28T22:13:54.034ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3392026-05-28T22:13:54.186ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("80f5c51a-a935-44d3-9ca0-c31eb65c4ab1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9fdf1c1d-eae7-4c21-b14f-4c4065398273.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f57dc2f6-0fff-4f5e-9cd8-89d49def9d20.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f57dc2f6-0fff-4f5e-9cd8-89d49def9d20.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1353, tv_nsec: 85612354 } }) unit = producer-server
3402026-05-28T22:13:54.186ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
3412026-05-28T22:13:54.193ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
3422026-05-28T22:13:54.776ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3432026-05-28T22:13:54.782ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3442026-05-28T22:13:54.786ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3452026-05-28T22:13:56.104ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3462026-05-28T22:13:56.110ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3472026-05-28T22:13:56.113ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3482026-05-28T22:13:57.027ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3492026-05-28T22:13:57.032ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3502026-05-28T22:13:57.035ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3512026-05-28T22:13:58.517ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3522026-05-28T22:13:58.523ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3532026-05-28T22:13:58.526ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3542026-05-28T22:13:59.536ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15466005652246622490 n_samples = 6 unit = oximeter
3552026-05-28T22:13:59.539ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10917210643743581506 n_samples = 6 unit = oximeter
3562026-05-28T22:13:59.889ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3572026-05-28T22:13:59.902ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3582026-05-28T22:13:59.905ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3592026-05-28T22:14:00.438ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3602026-05-28T22:14:00.444ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3612026-05-28T22:14:00.448ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3622026-05-28T22:14:01.662ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3632026-05-28T22:14:01.667ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3642026-05-28T22:14:01.671ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3652026-05-28T22:14:02.779ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3662026-05-28T22:14:02.785ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3672026-05-28T22:14:02.788ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3682026-05-28T22:14:03.751ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3692026-05-28T22:14:03.757ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3702026-05-28T22:14:03.760ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3712026-05-28T22:14:04.287ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3722026-05-28T22:14:04.293ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3732026-05-28T22:14:04.296ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3742026-05-28T22:14:05.072ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3752026-05-28T22:14:05.077ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3762026-05-28T22:14:05.079ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3772026-05-28T22:14:05.827ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3782026-05-28T22:14:05.833ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3792026-05-28T22:14:05.836ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3802026-05-28T22:14:06.721ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3812026-05-28T22:14:06.726ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3822026-05-28T22:14:06.729ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3832026-05-28T22:14:07.732ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3842026-05-28T22:14:07.737ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3852026-05-28T22:14:07.739ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3862026-05-28T22:14:08.326ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3872026-05-28T22:14:08.331ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3882026-05-28T22:14:08.334ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3892026-05-28T22:14:09.110ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3902026-05-28T22:14:09.114ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3912026-05-28T22:14:09.117ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3922026-05-28T22:14:09.194ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3932026-05-28T22:14:09.195ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 102.345530884s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3942026-05-28T22:14:09.538ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15466005652246622490 n_samples = 6 unit = oximeter
3952026-05-28T22:14:09.540ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10917210643743581506 n_samples = 6 unit = oximeter
3962026-05-28T22:14:10.551ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3972026-05-28T22:14:10.556ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
3982026-05-28T22:14:10.559ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
3992026-05-28T22:14:11.372ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4002026-05-28T22:14:11.377ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4012026-05-28T22:14:11.380ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4022026-05-28T22:14:12.163ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4032026-05-28T22:14:12.169ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4042026-05-28T22:14:12.172ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4052026-05-28T22:14:13.121ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4062026-05-28T22:14:13.126ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4072026-05-28T22:14:13.129ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4082026-05-28T22:14:14.218ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4092026-05-28T22:14:14.224ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4102026-05-28T22:14:14.227ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4112026-05-28T22:14:15.145ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4122026-05-28T22:14:15.151ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4132026-05-28T22:14:15.154ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4142026-05-28T22:14:15.747ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4152026-05-28T22:14:15.753ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4162026-05-28T22:14:15.756ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4172026-05-28T22:14:16.371ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4182026-05-28T22:14:16.377ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4192026-05-28T22:14:16.380ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4202026-05-28T22:14:17.750ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4212026-05-28T22:14:17.755ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4222026-05-28T22:14:17.758ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4232026-05-28T22:14:18.778ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4242026-05-28T22:14:18.787ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4252026-05-28T22:14:18.791ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4262026-05-28T22:14:19.519ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4272026-05-28T22:14:19.525ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4282026-05-28T22:14:19.528ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4292026-05-28T22:14:19.541ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15466005652246622490 n_samples = 6 unit = oximeter
4302026-05-28T22:14:19.541ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10917210643743581506 n_samples = 6 unit = oximeter
4312026-05-28T22:14:20.093ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4322026-05-28T22:14:20.098ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4332026-05-28T22:14:20.102ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4342026-05-28T22:14:21.068ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("80f5c51a-a935-44d3-9ca0-c31eb65c4ab1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9fdf1c1d-eae7-4c21-b14f-4c4065398273.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f57dc2f6-0fff-4f5e-9cd8-89d49def9d20.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f57dc2f6-0fff-4f5e-9cd8-89d49def9d20.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1379, tv_nsec: 967821086 } }) unit = producer-server
4352026-05-28T22:14:21.069ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
4362026-05-28T22:14:21.078ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
4372026-05-28T22:14:21.191ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4382026-05-28T22:14:21.197ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4392026-05-28T22:14:21.200ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4402026-05-28T22:14:22.188ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4412026-05-28T22:14:22.194ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4422026-05-28T22:14:22.197ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4432026-05-28T22:14:22.787ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4442026-05-28T22:14:22.793ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4452026-05-28T22:14:22.796ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4462026-05-28T22:14:23.909ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4472026-05-28T22:14:23.914ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4482026-05-28T22:14:23.917ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4492026-05-28T22:14:24.523ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4502026-05-28T22:14:24.529ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4512026-05-28T22:14:24.532ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4522026-05-28T22:14:25.089ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4532026-05-28T22:14:25.094ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4542026-05-28T22:14:25.097ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4552026-05-28T22:14:25.997ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4562026-05-28T22:14:26.002ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4572026-05-28T22:14:26.006ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4582026-05-28T22:14:26.835ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4592026-05-28T22:14:26.841ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4602026-05-28T22:14:26.844ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4612026-05-28T22:14:28.060ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4622026-05-28T22:14:28.065ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4632026-05-28T22:14:28.069ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4642026-05-28T22:14:28.962ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4652026-05-28T22:14:28.968ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4662026-05-28T22:14:28.971ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4672026-05-28T22:14:29.543ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15466005652246622490 n_samples = 6 unit = oximeter
4682026-05-28T22:14:29.543ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10917210643743581506 n_samples = 6 unit = oximeter
4692026-05-28T22:14:29.732ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4702026-05-28T22:14:29.737ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4712026-05-28T22:14:29.739ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4722026-05-28T22:14:30.899ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4732026-05-28T22:14:30.905ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4742026-05-28T22:14:30.908ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4752026-05-28T22:14:31.963ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4762026-05-28T22:14:31.968ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4772026-05-28T22:14:31.971ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4782026-05-28T22:14:33.234ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4792026-05-28T22:14:33.241ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4802026-05-28T22:14:33.245ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4812026-05-28T22:14:34.104ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4822026-05-28T22:14:34.110ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4832026-05-28T22:14:34.113ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4842026-05-28T22:14:35.431ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4852026-05-28T22:14:35.436ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4862026-05-28T22:14:35.439ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4872026-05-28T22:14:36.080ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
4882026-05-28T22:14:36.081ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 129.230492629s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4892026-05-28T22:14:36.332ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4902026-05-28T22:14:36.337ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4912026-05-28T22:14:36.340ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4922026-05-28T22:14:37.570ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4932026-05-28T22:14:37.575ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4942026-05-28T22:14:37.578ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4952026-05-28T22:14:38.636ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4962026-05-28T22:14:38.640ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
4972026-05-28T22:14:38.643ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
4982026-05-28T22:14:39.440ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4992026-05-28T22:14:39.445ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
5002026-05-28T22:14:39.448ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5012026-05-28T22:14:39.545ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15466005652246622490 n_samples = 6 unit = oximeter
5022026-05-28T22:14:39.546ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10917210643743581506 n_samples = 6 unit = oximeter
5032026-05-28T22:14:40.191ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5042026-05-28T22:14:40.197ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
5052026-05-28T22:14:40.200ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5062026-05-28T22:14:41.369ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5072026-05-28T22:14:41.373ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
5082026-05-28T22:14:41.376ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5092026-05-28T22:14:42.828ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5102026-05-28T22:14:42.833ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
5112026-05-28T22:14:42.836ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5122026-05-28T22:14:44.195ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5132026-05-28T22:14:44.199ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
5142026-05-28T22:14:44.203ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5152026-05-28T22:14:45.354ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5162026-05-28T22:14:45.359ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
5172026-05-28T22:14:45.363ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5182026-05-28T22:14:46.578ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5192026-05-28T22:14:46.583ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
5202026-05-28T22:14:46.586ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5212026-05-28T22:14:47.244ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5222026-05-28T22:14:47.249ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
5232026-05-28T22:14:47.252ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5242026-05-28T22:14:47.886ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5252026-05-28T22:14:47.891ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
5262026-05-28T22:14:47.894ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5272026-05-28T22:14:48.514ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5282026-05-28T22:14:48.519ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
5292026-05-28T22:14:48.522ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5302026-05-28T22:14:49.251ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5312026-05-28T22:14:49.256ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
5322026-05-28T22:14:49.258ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5332026-05-28T22:14:49.547ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15466005652246622490 n_samples = 6 unit = oximeter
5342026-05-28T22:14:49.548ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10917210643743581506 n_samples = 6 unit = oximeter
5352026-05-28T22:14:49.810ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("80f5c51a-a935-44d3-9ca0-c31eb65c4ab1.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("9fdf1c1d-eae7-4c21-b14f-4c4065398273.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("f57dc2f6-0fff-4f5e-9cd8-89d49def9d20.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f57dc2f6-0fff-4f5e-9cd8-89d49def9d20.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1408, tv_nsec: 709220843 } }) unit = producer-server
5362026-05-28T22:14:49.811ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
5372026-05-28T22:14:49.819ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
5382026-05-28T22:14:50.610ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5392026-05-28T22:14:50.618ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
5402026-05-28T22:14:50.624ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5412026-05-28T22:14:51.151ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5422026-05-28T22:14:51.162ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
5432026-05-28T22:14:51.171ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5442026-05-28T22:14:52.165ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5452026-05-28T22:14:52.172ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
5462026-05-28T22:14:52.176ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5472026-05-28T22:14:52.997ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5482026-05-28T22:14:53.003ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
5492026-05-28T22:14:53.051ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5502026-05-28T22:14:53.887ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5512026-05-28T22:14:53.896ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
5522026-05-28T22:14:54.024ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5532026-05-28T22:14:54.655ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5542026-05-28T22:14:54.666ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
5552026-05-28T22:14:54.671ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5562026-05-28T22:14:55.408ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5572026-05-28T22:14:55.418ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
5582026-05-28T22:14:55.425ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5592026-05-28T22:14:56.880ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5602026-05-28T22:14:56.889ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
5612026-05-28T22:14:56.898ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5622026-05-28T22:14:57.595ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5632026-05-28T22:14:57.602ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
5642026-05-28T22:14:57.609ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5652026-05-28T22:14:58.772ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5662026-05-28T22:14:58.778ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
5672026-05-28T22:14:58.783ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5682026-05-28T22:14:59.581ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 15466005652246622490 n_samples = 6 unit = oximeter
5692026-05-28T22:14:59.583ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10917210643743581506 n_samples = 6 unit = oximeter
5702026-05-28T22:15:00.267ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5712026-05-28T22:15:00.278ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
5722026-05-28T22:15:00.283ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]
5732026-05-28T22:15:01.084ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5742026-05-28T22:15:01.092ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::fc63:b4ff:fe58:7e9f]
5752026-05-28T22:15:01.096ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.1.174]