Max level shown:
1 [ May 28 01:12:15 Enabled. ]
2 [ May 28 01:12:15 Rereading configuration. ]
3 [ May 28 01:12:16 Rereading configuration. ]
4 [ May 28 01:12:27 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ May 28 01:12:27 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-05-28T01:12:27.323ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-05-28T01:12:27.324ZINFOtfportd: connected to dpd running softnpu-187aee7d
92026-05-28T01:12:27.325ZINFOtfportd: running in sync-only mode
102026-05-28T01:12:27.325ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-05-28T01:12:27.327ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-05-28T01:12:27.330ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( c94f7c1e-ef08-4c93-ae36-67fa1be6b725, ), sled_id: Some( 34f4b8d7-6257-4b25-ae1d-8934079e057a, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
142026-05-28T01:12:27.330ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-05-28T01:12:27.334ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::e4ae:43ff:fe1a:92f8->e6:ae:43:1a:92:f8 interface = tfportrear0_0
162026-05-28T01:12:27.335ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172026-05-28T01:12:27.342ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
182026-05-28T01:12:27.349ZWARNtfportd: tfportqsfp0_0 has no addrs
19 [ May 28 01:12:27 Rereading configuration. ]
20 [ May 28 01:12:27 Executing refresh method (:kill). ]
21 [ May 28 01:12:27 Stopping because all processes in service exited. ]
22 [ May 28 01:12:27 Executing stop method (:kill). ]
23 [ May 28 01:12:27 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
24 [ May 28 01:12:28 Method "start" exited with status 0. ]
252026-05-28T01:12:28.023ZINFOtfportd: connecting to dpd host = [::1] port = 12224
262026-05-28T01:12:28.024ZINFOtfportd: connected to dpd running softnpu-187aee7d
272026-05-28T01:12:28.024ZINFOtfportd: running in sync-only mode
282026-05-28T01:12:28.024ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
292026-05-28T01:12:28.026ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
302026-05-28T01:12:28.026ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: c94f7c1e-ef08-4c93-ae36-67fa1be6b725, sled_id: 34f4b8d7-6257-4b25-ae1d-8934079e057a, model: "i86pc", revision: 0, serial: "sock" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, fuse: Some(FuseData { chip_rev: ChipRevision { device_id: 272, rev: "B1", rev_num: 2 }, disabled: DisabledFeatures { bsync: false, mau: [0, 0, 0, 0], pgen: false, pipes: 0, ports: 0, resub: false, speeds: 0, tm_mem: 0 }, frequency: FrequencySettings { bps: 3, bps_ext: 0, cpu_speed_dis: 0, disabled: false, pcie_dis: 0, pps: 3, pps_ext: 0 }, manufacturing: ManufacturingData { core_repair: false, die_rotation: false, pmro_and_skew: 0, silent_spin: 0, soft_pipe_dis: 0, tile_repair: false, voltage_scaling: 0, wf_core_repair: false }, part: PartInfo { part_num: 4660, pkg_id: 1, version: 2 } }), lot: None, lotnum: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 27b3a561-5a8a-4947-be74-ce8aa52b60b0, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
312026-05-28T01:12:28.026ZDEBGtfportd: created producer ID producer_id = da0861a8-d7d5-4ef1-be5f-2044b953d2ef unit = oximeter
322026-05-28T01:12:28.028ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( c94f7c1e-ef08-4c93-ae36-67fa1be6b725, ), sled_id: Some( 34f4b8d7-6257-4b25-ae1d-8934079e057a, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
332026-05-28T01:12:28.035ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
342026-05-28T01:12:28.037ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::3c1b:90ff:febc:781->3e:1b:90:bc:07:81 interface = tfportrear0_0
352026-05-28T01:12:28.037ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::e4ae:43ff:fe1a:92f8->e6:ae:43:1a:92:f8 interface = tfportrear0_0
362026-05-28T01:12:28.038ZDEBGtfportd: registered DTrace probes unit = producer-server
372026-05-28T01:12:28.039ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:44612 method = GET path = /{producer_id} unit = producer-server versions = all
382026-05-28T01:12:28.039ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:44612 unit = producer-server
392026-05-28T01:12:28.039ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:44612 unit = producer-server
402026-05-28T01:12:28.039ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:44612 unit = producer-server
412026-05-28T01:12:28.039ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
422026-05-28T01:12:28.040ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
432026-05-28T01:12:28.040ZDEBGtfportd: starting producer registration task unit = producer-server
442026-05-28T01:12:28.040ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:44612 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = da0861a8-d7d5-4ef1-be5f-2044b953d2ef unit = producer-server
452026-05-28T01:12:28.040ZINFOtfportd: created oximeter producer server unit = oximeter
462026-05-28T01:12:28.040ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
472026-05-28T01:12:28.041ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
482026-05-28T01:12:28.041ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
492026-05-28T01:12:28.043ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-05-28T01:12:11.073865621Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
502026-05-28T01:12:28.043ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 3380016801928626656 unit = oximeter
512026-05-28T01:12:28.043ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
522026-05-28T01:12:28.044ZWARNtfportd: tfportqsfp0_0 has no addrs
532026-05-28T01:12:29.140ZINFOtfportd: added new ARP entry entry = 10.151.2.174->b2:d9:56:22:72:2c interface = tfportqsfp0_0
542026-05-28T01:12:29.203ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
552026-05-28T01:12:29.208ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
562026-05-28T01:12:29.211ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
572026-05-28T01:12:29.211ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
582026-05-28T01:12:29.212ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-05-28T01:12:11.073735268Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
592026-05-28T01:12:29.212ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 1404331039869887861 unit = oximeter
602026-05-28T01:12:29.212ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
612026-05-28T01:12:30.362ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
622026-05-28T01:12:30.368ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
632026-05-28T01:12:30.372ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
642026-05-28T01:12:31.810ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
652026-05-28T01:12:31.816ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
662026-05-28T01:12:31.819ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
672026-05-28T01:12:32.825ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
682026-05-28T01:12:32.830ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
692026-05-28T01:12:32.833ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
702026-05-28T01:12:33.042ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 5.001633461s error = "proto error: no records found for Query { name: Name(\\"_nexus._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
712026-05-28T01:12:33.398ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("21bc5605-6c10-4eea-b3e4-e0ea5ae50179.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("5bade9b0-e5d1-45f0-ac74-a5a1487a31d7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a3e826ce-aef2-43c6-89ed-030c917e28d7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a3e826ce-aef2-43c6-89ed-030c917e28d7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1936, tv_nsec: 621968389 } }) unit = producer-server
722026-05-28T01:12:33.398ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
732026-05-28T01:12:33.414ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
742026-05-28T01:12:34.180ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
752026-05-28T01:12:34.186ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
762026-05-28T01:12:34.189ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
772026-05-28T01:12:35.507ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
782026-05-28T01:12:35.512ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
792026-05-28T01:12:35.516ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
802026-05-28T01:12:36.130ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
812026-05-28T01:12:36.135ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
822026-05-28T01:12:36.139ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
832026-05-28T01:12:37.529ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
842026-05-28T01:12:37.534ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
852026-05-28T01:12:37.537ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
862026-05-28T01:12:38.045ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3380016801928626656 n_samples = 6 unit = oximeter
872026-05-28T01:12:39.034ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
882026-05-28T01:12:39.039ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
892026-05-28T01:12:39.041ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
902026-05-28T01:12:39.214ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1404331039869887861 n_samples = 6 unit = oximeter
912026-05-28T01:12:40.419ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
922026-05-28T01:12:40.425ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
932026-05-28T01:12:40.428ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
942026-05-28T01:12:41.130ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
952026-05-28T01:12:41.135ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
962026-05-28T01:12:41.138ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
972026-05-28T01:12:42.076ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
982026-05-28T01:12:42.081ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
992026-05-28T01:12:42.085ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1002026-05-28T01:12:43.041ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1012026-05-28T01:12:43.045ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1022026-05-28T01:12:43.049ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1032026-05-28T01:12:44.093ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1042026-05-28T01:12:44.098ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1052026-05-28T01:12:44.101ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1062026-05-28T01:12:45.016ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1072026-05-28T01:12:45.020ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1082026-05-28T01:12:45.023ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1092026-05-28T01:12:46.537ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1102026-05-28T01:12:46.541ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1112026-05-28T01:12:46.545ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1122026-05-28T01:12:47.216ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1132026-05-28T01:12:47.221ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1142026-05-28T01:12:47.224ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1152026-05-28T01:12:47.739ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3380016801928626656 n_samples = 6 unit = oximeter
1162026-05-28T01:12:47.990ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1172026-05-28T01:12:47.995ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1182026-05-28T01:12:47.998ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1192026-05-28T01:12:48.108ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1202026-05-28T01:12:48.109ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 20.376476957s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1212026-05-28T01:12:48.487ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("21bc5605-6c10-4eea-b3e4-e0ea5ae50179.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("5bade9b0-e5d1-45f0-ac74-a5a1487a31d7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a3e826ce-aef2-43c6-89ed-030c917e28d7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a3e826ce-aef2-43c6-89ed-030c917e28d7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1952, tv_nsec: 18532612 } }) unit = producer-server
1222026-05-28T01:12:48.488ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1232026-05-28T01:12:48.494ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1242026-05-28T01:12:48.633ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1252026-05-28T01:12:48.641ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1262026-05-28T01:12:48.644ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1272026-05-28T01:12:48.910ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1404331039869887861 n_samples = 6 unit = oximeter
1282026-05-28T01:12:49.212ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1292026-05-28T01:12:49.216ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1302026-05-28T01:12:49.219ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1312026-05-28T01:12:50.371ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1322026-05-28T01:12:50.376ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1332026-05-28T01:12:50.379ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1342026-05-28T01:12:51.341ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1352026-05-28T01:12:51.345ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1362026-05-28T01:12:51.349ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1372026-05-28T01:12:52.083ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1382026-05-28T01:12:52.087ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1392026-05-28T01:12:52.090ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1402026-05-28T01:12:52.727ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1412026-05-28T01:12:52.732ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1422026-05-28T01:12:52.735ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1432026-05-28T01:12:53.517ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1442026-05-28T01:12:53.522ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1452026-05-28T01:12:53.525ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1462026-05-28T01:12:54.635ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1472026-05-28T01:12:54.642ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1482026-05-28T01:12:54.646ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1492026-05-28T01:12:55.815ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1502026-05-28T01:12:55.822ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1512026-05-28T01:12:55.825ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1522026-05-28T01:12:56.784ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1532026-05-28T01:12:56.790ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1542026-05-28T01:12:56.798ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1552026-05-28T01:12:57.767ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3380016801928626656 n_samples = 6 unit = oximeter
1562026-05-28T01:12:58.139ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1572026-05-28T01:12:58.162ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1582026-05-28T01:12:58.609ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1592026-05-28T01:12:58.943ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1404331039869887861 n_samples = 6 unit = oximeter
1602026-05-28T01:12:59.862ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1612026-05-28T01:12:59.868ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1622026-05-28T01:12:59.872ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1632026-05-28T01:13:01.360ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1642026-05-28T01:13:01.367ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1652026-05-28T01:13:01.370ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1662026-05-28T01:13:02.282ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1672026-05-28T01:13:02.288ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1682026-05-28T01:13:02.291ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1692026-05-28T01:13:03.535ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1702026-05-28T01:13:03.536ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 35.762720517s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1712026-05-28T01:13:03.545ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1722026-05-28T01:13:03.551ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1732026-05-28T01:13:03.554ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1742026-05-28T01:13:04.408ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1752026-05-28T01:13:04.413ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1762026-05-28T01:13:04.416ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1772026-05-28T01:13:04.806ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("21bc5605-6c10-4eea-b3e4-e0ea5ae50179.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("5bade9b0-e5d1-45f0-ac74-a5a1487a31d7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a3e826ce-aef2-43c6-89ed-030c917e28d7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a3e826ce-aef2-43c6-89ed-030c917e28d7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1968, tv_nsec: 293928351 } }) unit = producer-server
1782026-05-28T01:13:04.806ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
1792026-05-28T01:13:04.813ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
1802026-05-28T01:13:05.155ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1812026-05-28T01:13:05.161ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1822026-05-28T01:13:05.165ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1832026-05-28T01:13:05.828ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1842026-05-28T01:13:05.834ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1852026-05-28T01:13:05.837ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1862026-05-28T01:13:07.087ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1872026-05-28T01:13:07.092ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1882026-05-28T01:13:07.095ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1892026-05-28T01:13:07.797ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3380016801928626656 n_samples = 6 unit = oximeter
1902026-05-28T01:13:08.431ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1912026-05-28T01:13:08.437ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1922026-05-28T01:13:08.441ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1932026-05-28T01:13:08.971ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1404331039869887861 n_samples = 6 unit = oximeter
1942026-05-28T01:13:08.976ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1952026-05-28T01:13:08.982ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1962026-05-28T01:13:08.985ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1972026-05-28T01:13:09.520ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1982026-05-28T01:13:09.526ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
1992026-05-28T01:13:09.530ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2002026-05-28T01:13:10.860ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2012026-05-28T01:13:10.866ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2022026-05-28T01:13:10.869ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2032026-05-28T01:13:11.616ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2042026-05-28T01:13:11.621ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2052026-05-28T01:13:11.625ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2062026-05-28T01:13:12.387ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2072026-05-28T01:13:12.392ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2082026-05-28T01:13:12.394ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2092026-05-28T01:13:13.030ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2102026-05-28T01:13:13.035ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2112026-05-28T01:13:13.038ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2122026-05-28T01:13:13.960ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2132026-05-28T01:13:13.965ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2142026-05-28T01:13:13.968ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2152026-05-28T01:13:14.691ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2162026-05-28T01:13:14.695ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2172026-05-28T01:13:14.698ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2182026-05-28T01:13:15.377ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2192026-05-28T01:13:15.381ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2202026-05-28T01:13:15.384ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2212026-05-28T01:13:16.524ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2222026-05-28T01:13:16.530ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2232026-05-28T01:13:16.534ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2242026-05-28T01:13:17.079ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2252026-05-28T01:13:17.085ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2262026-05-28T01:13:17.088ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2272026-05-28T01:13:17.811ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3380016801928626656 n_samples = 6 unit = oximeter
2282026-05-28T01:13:18.385ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2292026-05-28T01:13:18.391ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2302026-05-28T01:13:18.394ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2312026-05-28T01:13:18.981ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1404331039869887861 n_samples = 6 unit = oximeter
2322026-05-28T01:13:20.015ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2332026-05-28T01:13:20.015ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 52.189960385s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2342026-05-28T01:13:20.027ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2352026-05-28T01:13:20.035ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2362026-05-28T01:13:20.040ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2372026-05-28T01:13:21.224ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2382026-05-28T01:13:21.231ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2392026-05-28T01:13:21.235ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2402026-05-28T01:13:21.454ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("21bc5605-6c10-4eea-b3e4-e0ea5ae50179.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("5bade9b0-e5d1-45f0-ac74-a5a1487a31d7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a3e826ce-aef2-43c6-89ed-030c917e28d7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a3e826ce-aef2-43c6-89ed-030c917e28d7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 1984, tv_nsec: 922365560 } }) unit = producer-server
2412026-05-28T01:13:21.454ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
2422026-05-28T01:13:21.463ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2432026-05-28T01:13:22.003ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2442026-05-28T01:13:22.008ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2452026-05-28T01:13:22.011ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2462026-05-28T01:13:23.360ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2472026-05-28T01:13:23.367ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2482026-05-28T01:13:23.371ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2492026-05-28T01:13:24.015ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2502026-05-28T01:13:24.021ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2512026-05-28T01:13:24.024ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2522026-05-28T01:13:25.512ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2532026-05-28T01:13:25.518ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2542026-05-28T01:13:25.522ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2552026-05-28T01:13:26.341ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2562026-05-28T01:13:26.351ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2572026-05-28T01:13:26.360ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2582026-05-28T01:13:26.987ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2592026-05-28T01:13:26.996ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2602026-05-28T01:13:27.001ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2612026-05-28T01:13:34.934ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2622026-05-28T01:13:35.019ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2632026-05-28T01:13:35.304ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3380016801928626656 n_samples = 6 unit = oximeter
2642026-05-28T01:13:35.304ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1404331039869887861 n_samples = 6 unit = oximeter
2652026-05-28T01:13:35.490ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2662026-05-28T01:13:36.571ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2672026-05-28T01:13:36.607ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2682026-05-28T01:13:36.609ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2692026-05-28T01:13:36.622ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2702026-05-28T01:13:36.640ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 68.843610805s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2712026-05-28T01:13:37.717ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2722026-05-28T01:13:42.822ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2732026-05-28T01:13:43.166ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2742026-05-28T01:13:43.298ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("21bc5605-6c10-4eea-b3e4-e0ea5ae50179.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("5bade9b0-e5d1-45f0-ac74-a5a1487a31d7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a3e826ce-aef2-43c6-89ed-030c917e28d7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a3e826ce-aef2-43c6-89ed-030c917e28d7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 2006, tv_nsec: 683702663 } }) unit = producer-server
2752026-05-28T01:13:43.307ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
2762026-05-28T01:13:43.530ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
2772026-05-28T01:13:44.644ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2782026-05-28T01:13:44.682ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2792026-05-28T01:13:44.758ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2802026-05-28T01:13:45.327ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3380016801928626656 n_samples = 6 unit = oximeter
2812026-05-28T01:13:45.328ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1404331039869887861 n_samples = 6 unit = oximeter
2822026-05-28T01:13:45.556ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2832026-05-28T01:13:45.566ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2842026-05-28T01:13:45.572ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2852026-05-28T01:13:46.910ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2862026-05-28T01:13:46.919ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2872026-05-28T01:13:46.926ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2882026-05-28T01:13:47.820ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2892026-05-28T01:13:47.829ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2902026-05-28T01:13:47.836ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2912026-05-28T01:13:49.089ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2922026-05-28T01:13:49.099ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2932026-05-28T01:13:49.105ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2942026-05-28T01:13:49.699ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2952026-05-28T01:13:49.744ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2962026-05-28T01:13:49.777ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2972026-05-28T01:13:51.254ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2982026-05-28T01:13:51.267ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
2992026-05-28T01:13:51.271ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3002026-05-28T01:13:52.536ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3012026-05-28T01:13:52.545ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3022026-05-28T01:13:52.549ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3032026-05-28T01:13:53.110ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3042026-05-28T01:13:53.118ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3052026-05-28T01:13:53.123ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3062026-05-28T01:13:53.869ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3072026-05-28T01:13:53.877ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3082026-05-28T01:13:53.882ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3092026-05-28T01:13:54.768ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3102026-05-28T01:13:54.777ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3112026-05-28T01:13:54.782ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3122026-05-28T01:13:55.332ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3380016801928626656 n_samples = 6 unit = oximeter
3132026-05-28T01:13:55.335ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1404331039869887861 n_samples = 6 unit = oximeter
3142026-05-28T01:13:55.834ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3152026-05-28T01:13:55.842ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3162026-05-28T01:13:55.847ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3172026-05-28T01:13:57.089ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3182026-05-28T01:13:57.100ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3192026-05-28T01:13:57.104ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3202026-05-28T01:13:57.962ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3212026-05-28T01:13:57.970ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3222026-05-28T01:13:57.975ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3232026-05-28T01:13:58.536ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3242026-05-28T01:13:58.540ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 90.743911676s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3252026-05-28T01:13:59.011ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3262026-05-28T01:13:59.019ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3272026-05-28T01:13:59.024ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3282026-05-28T01:14:00.364ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3292026-05-28T01:14:00.370ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3302026-05-28T01:14:00.374ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3312026-05-28T01:14:01.353ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3322026-05-28T01:14:01.358ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3332026-05-28T01:14:01.361ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3342026-05-28T01:14:02.849ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3352026-05-28T01:14:02.854ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3362026-05-28T01:14:02.857ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3372026-05-28T01:14:03.998ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3382026-05-28T01:14:04.003ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3392026-05-28T01:14:04.005ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3402026-05-28T01:14:04.750ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3412026-05-28T01:14:04.756ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3422026-05-28T01:14:04.760ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3432026-05-28T01:14:05.331ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3442026-05-28T01:14:05.335ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3380016801928626656 n_samples = 6 unit = oximeter
3452026-05-28T01:14:05.337ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1404331039869887861 n_samples = 6 unit = oximeter
3462026-05-28T01:14:05.338ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3472026-05-28T01:14:05.342ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3482026-05-28T01:14:06.083ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3492026-05-28T01:14:06.089ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3502026-05-28T01:14:06.093ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3512026-05-28T01:14:06.960ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3522026-05-28T01:14:06.967ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3532026-05-28T01:14:06.970ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3542026-05-28T01:14:08.459ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3552026-05-28T01:14:08.467ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3562026-05-28T01:14:08.471ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3572026-05-28T01:14:09.089ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("21bc5605-6c10-4eea-b3e4-e0ea5ae50179.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("5bade9b0-e5d1-45f0-ac74-a5a1487a31d7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a3e826ce-aef2-43c6-89ed-030c917e28d7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a3e826ce-aef2-43c6-89ed-030c917e28d7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 2032, tv_nsec: 558351212 } }) unit = producer-server
3582026-05-28T01:14:09.090ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
3592026-05-28T01:14:09.110ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
3602026-05-28T01:14:09.197ZDEBGtfportd (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 503, headers: {"content-type": "application/json", "x-request-id": "032bf8e9-2be8-492c-85eb-3daf86a4d3a6", "content-length": "133", "date": "Thu, 28 May 2026 01:14:09 GMT"} }) unit = producer-server
3612026-05-28T01:14:09.200ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 101.404828819s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"032bf8e9-2be8-492c-85eb-3daf86a4d3a6\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Thu, 28 May 2026 01:14:09 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"032bf8e9-2be8-492c-85eb-3daf86a4d3a6\\" }" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3622026-05-28T01:14:09.390ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3632026-05-28T01:14:09.397ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3642026-05-28T01:14:09.402ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3652026-05-28T01:14:09.967ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3662026-05-28T01:14:09.975ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3672026-05-28T01:14:09.979ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3682026-05-28T01:14:11.281ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3692026-05-28T01:14:11.285ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3702026-05-28T01:14:11.288ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3712026-05-28T01:14:12.577ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3722026-05-28T01:14:12.582ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3732026-05-28T01:14:12.586ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3742026-05-28T01:14:13.550ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3752026-05-28T01:14:13.555ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3762026-05-28T01:14:13.558ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3772026-05-28T01:14:14.327ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3782026-05-28T01:14:14.334ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3792026-05-28T01:14:14.337ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3802026-05-28T01:14:15.340ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3380016801928626656 n_samples = 6 unit = oximeter
3812026-05-28T01:14:15.340ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1404331039869887861 n_samples = 6 unit = oximeter
3822026-05-28T01:14:15.448ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3832026-05-28T01:14:15.453ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3842026-05-28T01:14:15.456ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3852026-05-28T01:14:16.201ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3862026-05-28T01:14:16.206ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3872026-05-28T01:14:16.209ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3882026-05-28T01:14:16.902ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3892026-05-28T01:14:16.908ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3902026-05-28T01:14:16.911ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3912026-05-28T01:14:18.309ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3922026-05-28T01:14:18.316ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3932026-05-28T01:14:18.320ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3942026-05-28T01:14:19.657ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3952026-05-28T01:14:19.662ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3962026-05-28T01:14:19.665ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3972026-05-28T01:14:20.393ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3982026-05-28T01:14:20.399ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
3992026-05-28T01:14:20.402ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4002026-05-28T01:14:20.964ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4012026-05-28T01:14:20.968ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4022026-05-28T01:14:20.971ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4032026-05-28T01:14:22.107ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4042026-05-28T01:14:22.112ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4052026-05-28T01:14:22.115ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4062026-05-28T01:14:23.436ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4072026-05-28T01:14:23.442ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4082026-05-28T01:14:23.446ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4092026-05-28T01:14:24.528ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("21bc5605-6c10-4eea-b3e4-e0ea5ae50179.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("5bade9b0-e5d1-45f0-ac74-a5a1487a31d7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("a3e826ce-aef2-43c6-89ed-030c917e28d7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("a3e826ce-aef2-43c6-89ed-030c917e28d7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 2047, tv_nsec: 995700497 } }) unit = producer-server
4102026-05-28T01:14:24.537ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221 unit = producer-server
4112026-05-28T01:14:24.546ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
4122026-05-28T01:14:24.556ZDEBGtfportd (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "3c733f5d-7919-4ef8-82d2-5bde76f7766b", "content-length": "41", "date": "Thu, 28 May 2026 01:14:24 GMT"} }) unit = producer-server
4132026-05-28T01:14:24.557ZDEBGtfportd (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s unit = producer-server wait_period = 150s
4142026-05-28T01:14:24.681ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4152026-05-28T01:14:24.688ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4162026-05-28T01:14:24.691ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4172026-05-28T01:14:25.272ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4182026-05-28T01:14:25.279ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4192026-05-28T01:14:25.282ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4202026-05-28T01:14:25.342ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3380016801928626656 n_samples = 6 unit = oximeter
4212026-05-28T01:14:25.342ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1404331039869887861 n_samples = 6 unit = oximeter
4222026-05-28T01:14:25.773ZINFOtfportd (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:1025 local_addr = [fd00:1122:3344:101::2]:44612 remote_addr = [fd00:1122:3344:101::d]:64309 unit = producer-server
4232026-05-28T01:14:25.788ZINFOtfportd (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 12206 local_addr = [fd00:1122:3344:101::2]:44612 method = GET remote_addr = [fd00:1122:3344:101::d]:64309 req_id = b9b5126c-35a7-4f4b-9d3b-97cdc9a40c55 response_code = 200 unit = producer-server uri = /da0861a8-d7d5-4ef1-be5f-2044b953d2ef
4242026-05-28T01:14:26.623ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4252026-05-28T01:14:26.629ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4262026-05-28T01:14:26.633ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4272026-05-28T01:14:27.885ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4282026-05-28T01:14:27.891ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4292026-05-28T01:14:27.895ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4302026-05-28T01:14:29.343ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4312026-05-28T01:14:29.349ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4322026-05-28T01:14:29.352ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4332026-05-28T01:14:30.658ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4342026-05-28T01:14:30.662ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4352026-05-28T01:14:30.665ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4362026-05-28T01:14:31.387ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4372026-05-28T01:14:31.393ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4382026-05-28T01:14:31.396ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4392026-05-28T01:14:32.080ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4402026-05-28T01:14:32.085ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4412026-05-28T01:14:32.089ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4422026-05-28T01:14:32.708ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4432026-05-28T01:14:32.714ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4442026-05-28T01:14:32.716ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4452026-05-28T01:14:34.182ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4462026-05-28T01:14:34.187ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4472026-05-28T01:14:34.190ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4482026-05-28T01:14:34.826ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4492026-05-28T01:14:34.832ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4502026-05-28T01:14:34.835ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4512026-05-28T01:14:35.343ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3380016801928626656 n_samples = 6 unit = oximeter
4522026-05-28T01:14:35.344ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1404331039869887861 n_samples = 6 unit = oximeter
4532026-05-28T01:14:35.790ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4542026-05-28T01:14:35.796ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4552026-05-28T01:14:35.800ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4562026-05-28T01:14:37.186ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4572026-05-28T01:14:37.191ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4582026-05-28T01:14:37.194ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4592026-05-28T01:14:38.303ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4602026-05-28T01:14:38.309ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4612026-05-28T01:14:38.313ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4622026-05-28T01:14:38.950ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4632026-05-28T01:14:38.955ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4642026-05-28T01:14:38.959ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4652026-05-28T01:14:39.825ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4662026-05-28T01:14:39.830ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4672026-05-28T01:14:39.833ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4682026-05-28T01:14:41.303ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4692026-05-28T01:14:41.308ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4702026-05-28T01:14:41.311ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4712026-05-28T01:14:42.498ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4722026-05-28T01:14:42.503ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4732026-05-28T01:14:42.506ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4742026-05-28T01:14:43.967ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4752026-05-28T01:14:43.972ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4762026-05-28T01:14:43.976ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4772026-05-28T01:14:45.154ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4782026-05-28T01:14:45.159ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4792026-05-28T01:14:45.163ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4802026-05-28T01:14:45.344ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3380016801928626656 n_samples = 6 unit = oximeter
4812026-05-28T01:14:45.345ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1404331039869887861 n_samples = 6 unit = oximeter
4822026-05-28T01:14:46.266ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4832026-05-28T01:14:46.271ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4842026-05-28T01:14:46.274ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4852026-05-28T01:14:47.290ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4862026-05-28T01:14:47.296ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4872026-05-28T01:14:47.299ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4882026-05-28T01:14:48.518ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4892026-05-28T01:14:48.524ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4902026-05-28T01:14:48.527ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4912026-05-28T01:14:49.581ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4922026-05-28T01:14:49.588ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4932026-05-28T01:14:49.591ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4942026-05-28T01:14:50.117ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4952026-05-28T01:14:50.122ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4962026-05-28T01:14:50.125ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4972026-05-28T01:14:51.316ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4982026-05-28T01:14:51.322ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
4992026-05-28T01:14:51.325ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5002026-05-28T01:14:52.707ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5012026-05-28T01:14:52.717ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
5022026-05-28T01:14:52.720ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5032026-05-28T01:14:53.568ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5042026-05-28T01:14:53.573ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
5052026-05-28T01:14:53.582ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5062026-05-28T01:14:55.084ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5072026-05-28T01:14:55.090ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
5082026-05-28T01:14:55.093ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5092026-05-28T01:14:55.347ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 3380016801928626656 n_samples = 6 unit = oximeter
5102026-05-28T01:14:55.347ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 1404331039869887861 n_samples = 6 unit = oximeter
5112026-05-28T01:14:55.769ZINFOtfportd (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:867 latency_us = 373 local_addr = [fd00:1122:3344:101::2]:44612 method = GET remote_addr = [fd00:1122:3344:101::d]:64309 req_id = ea303635-0c76-4066-92d8-df5ad7b08278 response_code = 200 unit = producer-server uri = /da0861a8-d7d5-4ef1-be5f-2044b953d2ef
5122026-05-28T01:14:56.387ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5132026-05-28T01:14:56.393ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
5142026-05-28T01:14:56.396ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5152026-05-28T01:14:57.390ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5162026-05-28T01:14:57.395ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
5172026-05-28T01:14:57.398ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5182026-05-28T01:14:58.322ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5192026-05-28T01:14:58.329ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
5202026-05-28T01:14:58.332ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5212026-05-28T01:14:58.902ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5222026-05-28T01:14:58.908ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
5232026-05-28T01:14:58.911ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5242026-05-28T01:15:00.264ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5252026-05-28T01:15:00.270ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
5262026-05-28T01:15:00.273ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5272026-05-28T01:15:01.338ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5282026-05-28T01:15:01.347ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
5292026-05-28T01:15:01.353ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5302026-05-28T01:15:02.257ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5312026-05-28T01:15:02.266ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::e4ae:43ff:fe1a:92f8]
5322026-05-28T01:15:02.272ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]