Max level shown:
1 [ Aug 29 02:57:22 Enabled. ]
2 [ Aug 29 02:57:22 Rereading configuration. ]
3 [ Aug 29 02:57:23 Rereading configuration. ]
4 [ Aug 29 02:57:34 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
5 [ Aug 29 02:57:34 Method "start" exited with status 0. ]
6 No non-localhost IPv6 addresses found in SMF properties
72026-08-29T02:57:34.523ZINFOtfportd: connecting to dpd host = [::1] port = 12224
82026-08-29T02:57:34.525ZINFOtfportd: connected to dpd running softnpu-5cb3f22d
92026-08-29T02:57:34.525ZINFOtfportd: running in sync-only mode
102026-08-29T02:57:34.527ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
112026-08-29T02:57:34.528ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
12 No non-localhost IPv6 addresses found in SMF properties
132026-08-29T02:57:34.529ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( bc563cd6-87d1-4f97-b7bb-f5dd3fc9665d, ), sled_id: Some( 9feed2e5-3b25-47cb-9d39-7ba5e243fc18, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
142026-08-29T02:57:34.529ZINFOtfportd: no non-localhost IPv6 listen address available, waiting for SMF update unit = oximeter
152026-08-29T02:57:34.534ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::f8cb:5ff:fe6b:1101->fa:cb:05:6b:11:01 interface = tfportrear0_0
162026-08-29T02:57:34.536ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
172026-08-29T02:57:34.541ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
182026-08-29T02:57:34.546ZWARNtfportd: tfportqsfp0_0 has no addrs
192026-08-29T02:57:35.169ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
202026-08-29T02:57:35.175ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
212026-08-29T02:57:35.179ZWARNtfportd: tfportqsfp0_0 has no addrs
22 [ Aug 29 02:57:35 Rereading configuration. ]
23 [ Aug 29 02:57:35 Executing refresh method (:kill). ]
24 [ Aug 29 02:57:35 Stopping because all processes in service exited. ]
25 [ Aug 29 02:57:35 Executing stop method (:kill). ]
26 [ Aug 29 02:57:35 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/dendrite/bin/tfportd --sync-only &"). ]
27 [ Aug 29 02:57:35 Method "start" exited with status 0. ]
282026-08-29T02:57:35.230ZINFOtfportd: connecting to dpd host = [::1] port = 12224
292026-08-29T02:57:35.231ZINFOtfportd: connected to dpd running softnpu-5cb3f22d
302026-08-29T02:57:35.231ZINFOtfportd: running in sync-only mode
312026-08-29T02:57:35.231ZINFOtfportd: found suitable IPv6 address for oximeter producer server address = fd00:1122:3344:101::2 unit = oximeter
322026-08-29T02:57:35.233ZINFOtfportd: refreshing SMF config prior to waiting on signals unit = signal_handler
332026-08-29T02:57:35.234ZDEBGtfportd: extracted oximeter configuration data config = OximeterConfig { listen_address: fd00:1122:3344:101::2, sled_identifiers: SledIdentifiers { rack_id: bc563cd6-87d1-4f97-b7bb-f5dd3fc9665d, sled_id: 9feed2e5-3b25-47cb-9d39-7ba5e243fc18, model: "i86pc", revision: 0, serial: "sock" }, switch_identifiers: SwitchIdentifiers { asic_backend: "softnpu", fab: None, fuse: Some(FuseData { chip_rev: ChipRevision { device_id: 272, rev: "B1", rev_num: 2 }, disabled: DisabledFeatures { bsync: false, mau: [0, 0, 0, 0], pgen: false, pipes: 0, ports: 0, resub: false, speeds: 0, tm_mem: 0 }, frequency: FrequencySettings { bps: 3, bps_ext: 0, cpu_speed_dis: 0, disabled: false, pcie_dis: 0, pps: 3, pps_ext: 0 }, manufacturing: ManufacturingData { core_repair: false, die_rotation: false, pmro_and_skew: 0, silent_spin: 0, soft_pipe_dis: 0, tile_repair: false, voltage_scaling: 0, wf_core_repair: false }, part: PartInfo { part_num: 4660, pkg_id: 1, version: 2 } }), lot: None, lotnum: None, model: "FAKE_SIM_SIDECAR", revision: 0, serial: "SimSidecar0", sidecar_id: 386470cb-c3ff-410a-863d-9a8855f3b2b9, slot: 0, wafer: None, wafer_loc: None } } unit = oximeter
342026-08-29T02:57:35.234ZDEBGtfportd: created producer ID producer_id = 1bdc9ef8-7f0b-4956-acbf-14f0887928fc unit = oximeter
352026-08-29T02:57:35.235ZINFOtfportd: refreshed config: Config { log_file: None, log_format: Json, listen_addresses: [ [fd00:1122:3344:101::2]:12231, [::1]:12231, ], pkt_source: None, dpd_host: "[::1]", dpd_port: 12224, vlan_link: None, vlan_data: None, techport0_prefix: None, techport1_prefix: None, rack_id: Some( bc563cd6-87d1-4f97-b7bb-f5dd3fc9665d, ), sled_id: Some( 9feed2e5-3b25-47cb-9d39-7ba5e243fc18, ), sled_model: Some( "i86pc", ), sled_revision: Some( 0, ), sled_serial: Some( "sock", ), }
362026-08-29T02:57:35.242ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
372026-08-29T02:57:35.244ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::ec75:4aff:fe54:b49b->ee:75:4a:54:b4:9b interface = tfportrear0_0
382026-08-29T02:57:35.244ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::f8cb:5ff:fe6b:1101->fa:cb:05:6b:11:01 interface = tfportrear0_0
392026-08-29T02:57:35.246ZDEBGtfportd: registered DTrace probes unit = producer-server
402026-08-29T02:57:35.247ZDEBGtfportd (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::2]:43435 method = GET path = /{producer_id} unit = producer-server versions = all
412026-08-29T02:57:35.247ZINFOtfportd (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.7/src/server.rs:328 local_addr = [fd00:1122:3344:101::2]:43435 unit = producer-server
422026-08-29T02:57:35.247ZDEBGtfportd (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::2]:43435 unit = producer-server
432026-08-29T02:57:35.247ZDEBGtfportd: Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::2]:43435 unit = producer-server
442026-08-29T02:57:35.247ZDEBGtfportd: Nexus IP not provided, will use DNS to resolve it unit = producer-server
452026-08-29T02:57:35.247ZINFOtfportd (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/internal-dns/resolver/src/resolver.rs:144 unit = producer-server
462026-08-29T02:57:35.248ZDEBGtfportd: starting producer registration task unit = producer-server
472026-08-29T02:57:35.248ZINFOtfportd: starting oximeter metric producer server address = [fd00:1122:3344:101::2]:43435 file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 1bdc9ef8-7f0b-4956-acbf-14f0887928fc unit = producer-server
482026-08-29T02:57:35.248ZINFOtfportd: created oximeter producer server unit = oximeter
492026-08-29T02:57:35.248ZDEBGtfportd (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0 unit = producer-server
502026-08-29T02:57:35.248ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
512026-08-29T02:57:35.249ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
522026-08-29T02:57:35.249ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("17f2eccc-886c-489a-ab7e-e738ac5a4f6f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("59e6af81-59b6-4d74-ba02-b7e6fa4ecad4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("5d154bbd-46d7-436d-a0fb-eeec001b89d7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("5d154bbd-46d7-436d-a0fb-eeec001b89d7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 715, tv_nsec: 732620120 } }) unit = producer-server
532026-08-29T02:57:35.250ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-08-29T02:57:18.276397399Z path = KstatPath { module: "link", instance: 0, name: "tfportrear0_0" } unit = oximeter
542026-08-29T02:57:35.250ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 10756346972753370589 unit = oximeter
552026-08-29T02:57:35.250ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportrear0_0 unit = metrics-task-tracker
562026-08-29T02:57:35.250ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
572026-08-29T02:57:35.267ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
582026-08-29T02:57:35.268ZWARNtfportd: tfportqsfp0_0 has no addrs
592026-08-29T02:57:36.046ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
602026-08-29T02:57:36.054ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
612026-08-29T02:57:36.062ZWARNtfportd: tfportqsfp0_0 has no addrs
622026-08-29T02:57:36.180ZINFOtfportd: added new ARP entry entry = 10.151.2.174->d6:d7:2e:d0:7b:1c interface = tfportqsfp0_0
632026-08-29T02:57:37.404ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
642026-08-29T02:57:37.410ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
652026-08-29T02:57:37.413ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
662026-08-29T02:57:37.413ZDEBGtfportd (kstat-sampler): adding new target unit = oximeter
672026-08-29T02:57:37.414ZDEBGtfportd (kstat-sampler-worker): storing new creation time for tracked target creation_time = 2026-08-29T02:57:18.276265037Z path = KstatPath { module: "link", instance: 0, name: "tfportqsfp0_0" } unit = oximeter
682026-08-29T02:57:37.414ZDEBGtfportd (kstat-sampler-worker): inserted empty per-target sample queue id = 5840146271888448056 unit = oximeter
692026-08-29T02:57:37.415ZDEBGtfportd: added new link to kstat sampler link_kind = switch-port-control link_name = tfportqsfp0_0 unit = metrics-task-tracker
702026-08-29T02:57:38.790ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
712026-08-29T02:57:38.795ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
722026-08-29T02:57:38.798ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
732026-08-29T02:57:39.674ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
742026-08-29T02:57:39.679ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
752026-08-29T02:57:39.682ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
762026-08-29T02:57:40.711ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
772026-08-29T02:57:40.715ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
782026-08-29T02:57:40.718ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
792026-08-29T02:57:41.974ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
802026-08-29T02:57:41.978ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
812026-08-29T02:57:41.981ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
822026-08-29T02:57:43.094ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
832026-08-29T02:57:43.099ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
842026-08-29T02:57:43.102ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
852026-08-29T02:57:43.918ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
862026-08-29T02:57:43.923ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
872026-08-29T02:57:43.926ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
882026-08-29T02:57:44.506ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
892026-08-29T02:57:44.511ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
902026-08-29T02:57:44.514ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
912026-08-29T02:57:45.136ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
922026-08-29T02:57:45.141ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
932026-08-29T02:57:45.144ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
942026-08-29T02:57:45.254ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10756346972753370589 n_samples = 6 unit = oximeter
952026-08-29T02:57:46.537ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
962026-08-29T02:57:46.542ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
972026-08-29T02:57:46.545ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
982026-08-29T02:57:47.417ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5840146271888448056 n_samples = 6 unit = oximeter
992026-08-29T02:57:47.846ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1002026-08-29T02:57:47.851ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1012026-08-29T02:57:47.854ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1022026-08-29T02:57:49.597ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1032026-08-29T02:57:49.602ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1042026-08-29T02:57:49.605ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1052026-08-29T02:57:50.971ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1062026-08-29T02:57:50.972ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 0 delay = 15.021255642s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1072026-08-29T02:57:51.014ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1082026-08-29T02:57:51.003ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1092026-08-29T02:57:51.006ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1102026-08-29T02:57:51.232ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("17f2eccc-886c-489a-ab7e-e738ac5a4f6f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("59e6af81-59b6-4d74-ba02-b7e6fa4ecad4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("5d154bbd-46d7-436d-a0fb-eeec001b89d7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("5d154bbd-46d7-436d-a0fb-eeec001b89d7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 731, tv_nsec: 27221022 } }) unit = producer-server
1112026-08-29T02:57:51.232ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
1122026-08-29T02:57:51.239ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1132026-08-29T02:57:52.390ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1142026-08-29T02:57:52.395ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1152026-08-29T02:57:52.398ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1162026-08-29T02:57:53.432ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1172026-08-29T02:57:53.437ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1182026-08-29T02:57:53.440ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1192026-08-29T02:57:54.856ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1202026-08-29T02:57:54.862ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1212026-08-29T02:57:54.865ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1222026-08-29T02:57:55.894ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1232026-08-29T02:57:55.898ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1242026-08-29T02:57:55.901ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1252026-08-29T02:57:55.935ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10756346972753370589 n_samples = 6 unit = oximeter
1262026-08-29T02:57:56.559ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1272026-08-29T02:57:56.564ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1282026-08-29T02:57:56.567ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1292026-08-29T02:57:57.718ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1302026-08-29T02:57:57.723ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1312026-08-29T02:57:57.726ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1322026-08-29T02:57:58.092ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5840146271888448056 n_samples = 6 unit = oximeter
1332026-08-29T02:57:59.039ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1342026-08-29T02:57:59.044ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1352026-08-29T02:57:59.047ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1362026-08-29T02:57:59.985ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1372026-08-29T02:57:59.989ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1382026-08-29T02:57:59.993ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1392026-08-29T02:58:00.569ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1402026-08-29T02:58:00.573ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1412026-08-29T02:58:00.576ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1422026-08-29T02:58:01.592ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1432026-08-29T02:58:01.597ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1442026-08-29T02:58:01.600ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1452026-08-29T02:58:02.514ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1462026-08-29T02:58:02.519ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1472026-08-29T02:58:02.523ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1482026-08-29T02:58:03.985ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1492026-08-29T02:58:03.990ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1502026-08-29T02:58:03.994ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1512026-08-29T02:58:05.205ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1522026-08-29T02:58:05.210ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1532026-08-29T02:58:05.213ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1542026-08-29T02:58:05.758ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1552026-08-29T02:58:05.763ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1562026-08-29T02:58:05.766ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1572026-08-29T02:58:05.910ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10756346972753370589 n_samples = 6 unit = oximeter
1582026-08-29T02:58:06.204ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
1592026-08-29T02:58:06.204ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 1 delay = 30.305353387s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
1602026-08-29T02:58:06.772ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("17f2eccc-886c-489a-ab7e-e738ac5a4f6f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("59e6af81-59b6-4d74-ba02-b7e6fa4ecad4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("5d154bbd-46d7-436d-a0fb-eeec001b89d7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("5d154bbd-46d7-436d-a0fb-eeec001b89d7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 746, tv_nsec: 605801582 } }) unit = producer-server
1612026-08-29T02:58:06.773ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
1622026-08-29T02:58:06.781ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1632026-08-29T02:58:07.263ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1642026-08-29T02:58:07.269ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1652026-08-29T02:58:07.272ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1662026-08-29T02:58:08.067ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5840146271888448056 n_samples = 6 unit = oximeter
1672026-08-29T02:58:08.070ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1682026-08-29T02:58:08.075ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1692026-08-29T02:58:08.078ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1702026-08-29T02:58:08.843ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1712026-08-29T02:58:08.848ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1722026-08-29T02:58:08.851ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1732026-08-29T02:58:10.202ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1742026-08-29T02:58:10.206ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1752026-08-29T02:58:10.209ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1762026-08-29T02:58:11.630ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1772026-08-29T02:58:11.635ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1782026-08-29T02:58:11.638ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1792026-08-29T02:58:12.695ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1802026-08-29T02:58:12.700ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1812026-08-29T02:58:12.703ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1822026-08-29T02:58:13.378ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1832026-08-29T02:58:13.383ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1842026-08-29T02:58:13.386ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1852026-08-29T02:58:14.279ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1862026-08-29T02:58:14.284ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1872026-08-29T02:58:14.287ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1882026-08-29T02:58:14.996ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1892026-08-29T02:58:15.001ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1902026-08-29T02:58:15.004ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1912026-08-29T02:58:15.885ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10756346972753370589 n_samples = 6 unit = oximeter
1922026-08-29T02:58:16.056ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1932026-08-29T02:58:16.061ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1942026-08-29T02:58:16.064ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1952026-08-29T02:58:17.523ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
1962026-08-29T02:58:17.527ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
1972026-08-29T02:58:17.530ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
1982026-08-29T02:58:18.042ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5840146271888448056 n_samples = 6 unit = oximeter
1992026-08-29T02:58:18.788ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2002026-08-29T02:58:18.793ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2012026-08-29T02:58:18.796ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2022026-08-29T02:58:19.497ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2032026-08-29T02:58:19.502ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2042026-08-29T02:58:19.505ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2052026-08-29T02:58:20.465ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2062026-08-29T02:58:20.469ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2072026-08-29T02:58:20.472ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2082026-08-29T02:58:21.741ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2092026-08-29T02:58:21.742ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 2 delay = 45.88527892s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2102026-08-29T02:58:21.900ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2112026-08-29T02:58:21.905ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2122026-08-29T02:58:21.908ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2132026-08-29T02:58:23.001ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("17f2eccc-886c-489a-ab7e-e738ac5a4f6f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("59e6af81-59b6-4d74-ba02-b7e6fa4ecad4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("5d154bbd-46d7-436d-a0fb-eeec001b89d7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("5d154bbd-46d7-436d-a0fb-eeec001b89d7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 762, tv_nsec: 878952711 } }) unit = producer-server
2142026-08-29T02:58:23.002ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
2152026-08-29T02:58:23.008ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
2162026-08-29T02:58:23.400ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2172026-08-29T02:58:23.405ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2182026-08-29T02:58:23.409ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2192026-08-29T02:58:24.330ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2202026-08-29T02:58:24.335ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2212026-08-29T02:58:24.337ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2222026-08-29T02:58:25.098ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2232026-08-29T02:58:25.103ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2242026-08-29T02:58:25.106ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2252026-08-29T02:58:25.731ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2262026-08-29T02:58:25.736ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2272026-08-29T02:58:25.739ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2282026-08-29T02:58:25.860ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10756346972753370589 n_samples = 6 unit = oximeter
2292026-08-29T02:58:27.158ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2302026-08-29T02:58:27.165ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2312026-08-29T02:58:27.168ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2322026-08-29T02:58:28.025ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5840146271888448056 n_samples = 6 unit = oximeter
2332026-08-29T02:58:28.253ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2342026-08-29T02:58:28.258ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2352026-08-29T02:58:28.261ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2362026-08-29T02:58:29.029ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2372026-08-29T02:58:29.034ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2382026-08-29T02:58:29.037ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2392026-08-29T02:58:30.772ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2402026-08-29T02:58:30.782ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2412026-08-29T02:58:30.788ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2422026-08-29T02:58:32.059ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2432026-08-29T02:58:32.097ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2442026-08-29T02:58:32.102ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2452026-08-29T02:58:33.044ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2462026-08-29T02:58:33.051ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2472026-08-29T02:58:33.055ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2482026-08-29T02:58:34.116ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2492026-08-29T02:58:34.130ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2502026-08-29T02:58:34.138ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2512026-08-29T02:58:34.889ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2522026-08-29T02:58:34.893ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2532026-08-29T02:58:34.896ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2542026-08-29T02:58:35.834ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10756346972753370589 n_samples = 6 unit = oximeter
2552026-08-29T02:58:36.214ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2562026-08-29T02:58:36.218ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2572026-08-29T02:58:36.221ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2582026-08-29T02:58:37.181ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2592026-08-29T02:58:37.187ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2602026-08-29T02:58:37.191ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2612026-08-29T02:58:37.944ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2622026-08-29T02:58:37.956ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2632026-08-29T02:58:37.959ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2642026-08-29T02:58:37.969ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
2652026-08-29T02:58:37.970ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 3 delay = 62.157238379s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
2662026-08-29T02:58:38.001ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5840146271888448056 n_samples = 6 unit = oximeter
2672026-08-29T02:58:38.952ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2682026-08-29T02:58:38.958ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2692026-08-29T02:58:38.961ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2702026-08-29T02:58:40.210ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2712026-08-29T02:58:40.217ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2722026-08-29T02:58:40.222ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2732026-08-29T02:58:40.754ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("17f2eccc-886c-489a-ab7e-e738ac5a4f6f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("59e6af81-59b6-4d74-ba02-b7e6fa4ecad4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("5d154bbd-46d7-436d-a0fb-eeec001b89d7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("5d154bbd-46d7-436d-a0fb-eeec001b89d7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 780, tv_nsec: 675751692 } }) unit = producer-server
2742026-08-29T02:58:40.757ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
2752026-08-29T02:58:40.764ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
2762026-08-29T02:58:40.789ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2772026-08-29T02:58:40.795ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2782026-08-29T02:58:40.799ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2792026-08-29T02:58:41.896ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2802026-08-29T02:58:41.901ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2812026-08-29T02:58:41.907ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2822026-08-29T02:58:43.399ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2832026-08-29T02:58:43.404ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2842026-08-29T02:58:43.407ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2852026-08-29T02:58:44.116ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2862026-08-29T02:58:44.121ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2872026-08-29T02:58:44.124ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2882026-08-29T02:58:44.729ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2892026-08-29T02:58:44.735ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2902026-08-29T02:58:44.738ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2912026-08-29T02:58:45.517ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2922026-08-29T02:58:45.522ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2932026-08-29T02:58:45.526ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2942026-08-29T02:58:45.827ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10756346972753370589 n_samples = 6 unit = oximeter
2952026-08-29T02:58:46.501ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2962026-08-29T02:58:46.506ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
2972026-08-29T02:58:46.509ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
2982026-08-29T02:58:47.283ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
2992026-08-29T02:58:47.289ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3002026-08-29T02:58:47.291ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3012026-08-29T02:58:48.000ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5840146271888448056 n_samples = 6 unit = oximeter
3022026-08-29T02:58:48.028ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3032026-08-29T02:58:48.034ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3042026-08-29T02:58:48.037ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3052026-08-29T02:58:49.016ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3062026-08-29T02:58:49.020ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3072026-08-29T02:58:49.024ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3082026-08-29T02:58:50.190ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3092026-08-29T02:58:50.195ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3102026-08-29T02:58:50.198ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3112026-08-29T02:58:52.568ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3122026-08-29T02:58:52.574ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3132026-08-29T02:58:52.578ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3142026-08-29T02:58:53.851ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3152026-08-29T02:58:53.860ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3162026-08-29T02:58:53.865ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3172026-08-29T02:58:55.170ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3182026-08-29T02:58:55.176ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3192026-08-29T02:58:55.179ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3202026-08-29T02:58:55.765ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3212026-08-29T02:58:55.767ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 4 delay = 79.957445507s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3222026-08-29T02:58:55.836ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10756346972753370589 n_samples = 6 unit = oximeter
3232026-08-29T02:58:55.970ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3242026-08-29T02:58:55.977ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3252026-08-29T02:58:55.980ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3262026-08-29T02:58:56.877ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3272026-08-29T02:58:56.886ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3282026-08-29T02:58:56.891ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3292026-08-29T02:58:58.002ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5840146271888448056 n_samples = 6 unit = oximeter
3302026-08-29T02:58:58.019ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3312026-08-29T02:58:58.028ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3322026-08-29T02:58:58.034ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3332026-08-29T02:58:58.749ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3342026-08-29T02:58:59.483ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("17f2eccc-886c-489a-ab7e-e738ac5a4f6f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("59e6af81-59b6-4d74-ba02-b7e6fa4ecad4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("5d154bbd-46d7-436d-a0fb-eeec001b89d7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("5d154bbd-46d7-436d-a0fb-eeec001b89d7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 799, tv_nsec: 404543691 } }) unit = producer-server
3352026-08-29T02:59:00.242ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
3362026-08-29T02:59:00.307ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3372026-08-29T02:59:00.363ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3382026-08-29T02:59:00.454ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
3392026-08-29T02:59:07.911ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10756346972753370589 n_samples = 6 unit = oximeter
3402026-08-29T02:59:07.922ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3412026-08-29T02:59:08.005ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5840146271888448056 n_samples = 6 unit = oximeter
3422026-08-29T02:59:08.089ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3432026-08-29T02:59:08.371ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3442026-08-29T02:59:09.666ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3452026-08-29T02:59:09.673ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3462026-08-29T02:59:09.679ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3472026-08-29T02:59:11.226ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3482026-08-29T02:59:11.242ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3492026-08-29T02:59:11.255ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3502026-08-29T02:59:12.520ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3512026-08-29T02:59:12.527ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3522026-08-29T02:59:12.532ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3532026-08-29T02:59:13.146ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3542026-08-29T02:59:13.157ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3552026-08-29T02:59:13.162ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3562026-08-29T02:59:13.793ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3572026-08-29T02:59:13.803ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3582026-08-29T02:59:13.808ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3592026-08-29T02:59:15.255ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3602026-08-29T02:59:15.264ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3612026-08-29T02:59:15.269ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3622026-08-29T02:59:15.496ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: TimedOut }) unit = producer-server
3632026-08-29T02:59:15.511ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 5 delay = 99.701502479s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
3642026-08-29T02:59:15.924ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3652026-08-29T02:59:15.993ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3662026-08-29T02:59:16.005ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3672026-08-29T02:59:16.667ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3682026-08-29T02:59:16.679ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3692026-08-29T02:59:16.685ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3702026-08-29T02:59:17.431ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3712026-08-29T02:59:17.438ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3722026-08-29T02:59:17.444ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3732026-08-29T02:59:17.960ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10756346972753370589 n_samples = 6 unit = oximeter
3742026-08-29T02:59:18.033ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5840146271888448056 n_samples = 6 unit = oximeter
3752026-08-29T02:59:18.044ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3762026-08-29T02:59:18.149ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3772026-08-29T02:59:18.174ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3782026-08-29T02:59:19.331ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3792026-08-29T02:59:19.356ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3802026-08-29T02:59:19.394ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3812026-08-29T02:59:20.654ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3822026-08-29T02:59:20.663ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3832026-08-29T02:59:20.684ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3842026-08-29T02:59:21.199ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3852026-08-29T02:59:21.206ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3862026-08-29T02:59:21.211ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3872026-08-29T02:59:22.484ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3882026-08-29T02:59:22.493ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3892026-08-29T02:59:22.498ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3902026-08-29T02:59:23.573ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3912026-08-29T02:59:23.583ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3922026-08-29T02:59:23.588ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3932026-08-29T02:59:24.203ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3942026-08-29T02:59:24.213ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3952026-08-29T02:59:24.217ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3962026-08-29T02:59:25.046ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
3972026-08-29T02:59:25.058ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
3982026-08-29T02:59:25.064ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
3992026-08-29T02:59:26.403ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4002026-08-29T02:59:26.417ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4012026-08-29T02:59:26.422ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4022026-08-29T02:59:27.319ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("17f2eccc-886c-489a-ab7e-e738ac5a4f6f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("59e6af81-59b6-4d74-ba02-b7e6fa4ecad4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("5d154bbd-46d7-436d-a0fb-eeec001b89d7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("5d154bbd-46d7-436d-a0fb-eeec001b89d7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 827, tv_nsec: 237267474 } }) unit = producer-server
4032026-08-29T02:59:27.322ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
4042026-08-29T02:59:27.394ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
4052026-08-29T02:59:27.449ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4062026-08-29T02:59:27.459ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4072026-08-29T02:59:27.464ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4082026-08-29T02:59:27.966ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10756346972753370589 n_samples = 6 unit = oximeter
4092026-08-29T02:59:28.038ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5840146271888448056 n_samples = 6 unit = oximeter
4102026-08-29T02:59:28.754ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4112026-08-29T02:59:28.763ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4122026-08-29T02:59:28.767ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4132026-08-29T02:59:29.693ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4142026-08-29T02:59:29.700ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4152026-08-29T02:59:29.703ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4162026-08-29T02:59:30.168ZINFOtfportd: removed stale NDP entry :fe80::ec75:4aff:fe54:b49b->ee:75:4a:54:b4:9b
4172026-08-29T02:59:30.377ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4182026-08-29T02:59:30.383ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4192026-08-29T02:59:30.386ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4202026-08-29T02:59:30.988ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4212026-08-29T02:59:30.996ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4222026-08-29T02:59:31.001ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4232026-08-29T02:59:31.074ZINFOtfportd: added new NDP entry entry = tfportrear0_0:fe80::ec75:4aff:fe54:b49b->ee:75:4a:54:b4:9b interface = tfportrear0_0
4242026-08-29T02:59:31.671ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4252026-08-29T02:59:31.679ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4262026-08-29T02:59:31.683ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4272026-08-29T02:59:31.927ZDEBGtfportd (producer-registration-task): client response result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", source: hyper_util::client::legacy::Error(Connect, ConnectError("tcp connect error", [fd00:1122:3344:101::c]:12221, Os { code: 146, kind: ConnectionRefused, message: "Connection refused" })) }) unit = producer-server
4282026-08-29T02:59:31.930ZWARNtfportd (producer-registration-task): failed to register with Nexus, will retry count = 6 delay = 116.119912102s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = /home/build/.cargo/git/checkouts/omicron-e0115f488d1c1d58/8e30605/oximeter/producer/src/lib.rs:371 unit = producer-server
4292026-08-29T02:59:32.909ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4302026-08-29T02:59:32.914ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4312026-08-29T02:59:32.916ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4322026-08-29T02:59:33.832ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4332026-08-29T02:59:33.838ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4342026-08-29T02:59:33.841ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4352026-08-29T02:59:34.493ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4362026-08-29T02:59:34.499ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4372026-08-29T02:59:34.503ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4382026-08-29T02:59:35.723ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4392026-08-29T02:59:35.728ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4402026-08-29T02:59:35.731ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4412026-08-29T02:59:36.721ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4422026-08-29T02:59:36.727ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4432026-08-29T02:59:36.730ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4442026-08-29T02:59:37.896ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4452026-08-29T02:59:37.902ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4462026-08-29T02:59:37.906ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4472026-08-29T02:59:37.969ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10756346972753370589 n_samples = 6 unit = oximeter
4482026-08-29T02:59:38.040ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5840146271888448056 n_samples = 6 unit = oximeter
4492026-08-29T02:59:39.401ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4502026-08-29T02:59:39.408ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4512026-08-29T02:59:39.412ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4522026-08-29T02:59:40.812ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4532026-08-29T02:59:40.818ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4542026-08-29T02:59:40.821ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4552026-08-29T02:59:41.561ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4562026-08-29T02:59:41.570ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4572026-08-29T02:59:41.576ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4582026-08-29T02:59:42.360ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4592026-08-29T02:59:42.367ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4602026-08-29T02:59:42.370ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4612026-08-29T02:59:43.169ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4622026-08-29T02:59:43.178ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4632026-08-29T02:59:43.183ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4642026-08-29T02:59:44.519ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4652026-08-29T02:59:44.526ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4662026-08-29T02:59:44.529ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4672026-08-29T02:59:45.648ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4682026-08-29T02:59:45.655ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4692026-08-29T02:59:45.659ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4702026-08-29T02:59:46.613ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4712026-08-29T02:59:46.619ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4722026-08-29T02:59:46.622ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4732026-08-29T02:59:47.829ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4742026-08-29T02:59:47.834ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4752026-08-29T02:59:47.837ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4762026-08-29T02:59:47.974ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10756346972753370589 n_samples = 6 unit = oximeter
4772026-08-29T02:59:48.042ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5840146271888448056 n_samples = 6 unit = oximeter
4782026-08-29T02:59:48.655ZDEBGtfportd (internal-dns-resolver): lookup_socket_v6 srv dns_name = _nexus._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("17f2eccc-886c-489a-ab7e-e738ac5a4f6f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("59e6af81-59b6-4d74-ba02-b7e6fa4ecad4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nexus._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12221, target: Name("5d154bbd-46d7-436d-a0fb-eeec001b89d7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("5d154bbd-46d7-436d-a0fb-eeec001b89d7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::a)) }], valid_until: Instant { tv_sec: 848, tv_nsec: 576847781 } }) unit = producer-server
4792026-08-29T02:59:48.656ZDEBGtfportd (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221 unit = producer-server
4802026-08-29T02:59:48.662ZDEBGtfportd (producer-registration-task): client request body = Some(Body) method = POST unit = producer-server uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
4812026-08-29T02:59:48.729ZDEBGtfportd (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "9f921471-6105-4eb3-af04-d3f4f9784cd0", "content-length": "41", "date": "Sat, 29 Aug 2026 02:59:48 GMT"} }) unit = producer-server
4822026-08-29T02:59:48.732ZDEBGtfportd (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s unit = producer-server wait_period = 150s
4832026-08-29T02:59:49.028ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4842026-08-29T02:59:49.033ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4852026-08-29T02:59:49.036ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4862026-08-29T02:59:49.917ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4872026-08-29T02:59:49.923ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4882026-08-29T02:59:49.926ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4892026-08-29T02:59:51.420ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4902026-08-29T02:59:51.427ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4912026-08-29T02:59:51.430ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4922026-08-29T02:59:52.843ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4932026-08-29T02:59:52.854ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4942026-08-29T02:59:52.857ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4952026-08-29T02:59:54.073ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4962026-08-29T02:59:54.079ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
4972026-08-29T02:59:54.081ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
4982026-08-29T02:59:55.357ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
4992026-08-29T02:59:55.363ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
5002026-08-29T02:59:55.367ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5012026-08-29T02:59:56.778ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5022026-08-29T02:59:56.785ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
5032026-08-29T02:59:56.789ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5042026-08-29T02:59:57.976ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 10756346972753370589 n_samples = 6 unit = oximeter
5052026-08-29T02:59:58.043ZDEBGtfportd (kstat-sampler-worker): pulled samples from target id = 5840146271888448056 n_samples = 6 unit = oximeter
5062026-08-29T02:59:58.173ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5072026-08-29T02:59:58.179ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
5082026-08-29T02:59:58.183ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5092026-08-29T02:59:59.381ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5102026-08-29T02:59:59.388ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
5112026-08-29T02:59:59.392ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5122026-08-29T03:00:00.262ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5132026-08-29T03:00:00.270ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
5142026-08-29T03:00:00.274ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]
5152026-08-29T03:00:01.761ZDEBGtfportd: found simports [ "tfportrear0_0", "tfportqsfp0_0", ]
5162026-08-29T03:00:01.770ZDEBGtfportd: sync tfportrear0_0 addrs [fe80::f8cb:5ff:fe6b:1101]
5172026-08-29T03:00:01.775ZDEBGtfportd: sync tfportqsfp0_0 addrs [10.151.2.174]